Sep 28 04:57:41 devstack cinder-volume[75765]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 04:57:41 devstack cinder-volume[75765]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 04:57:41 devstack cinder-volume[75765]: we strongly recommend against using it for new projects. Sep 28 04:57:41 devstack cinder-volume[75765]: If you are already using Eventlet, we recommend migrating to a different Sep 28 04:57:41 devstack cinder-volume[75765]: framework. For more detail see Sep 28 04:57:41 devstack cinder-volume[75765]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 04:57:41 devstack cinder-volume[75765]: import eventlet # noqa Sep 28 04:57:44 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 04:57:44 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 04:57:44 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 04:57:45 devstack cinder-volume[75765]: INFO dbcounter [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Registered counter for database cinder Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writer thread running {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 04:57:45 devstack cinder-volume[75765]: INFO cinder.rpc [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 04:57:45 devstack cinder-volume[75765]: INFO cinder.rpc [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 04:57:45 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Determined volume DB was empty at startup. Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75765) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 04:57:45 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 04:57:45 devstack cinder-volume[75765]: WARNING stevedore.named [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 04:57:45 devstack cinder-volume[75765]: WARNING castellan.key_manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 04:57:45 devstack cinder-volume[75765]: WARNING cinder.keymgr.conf_key_mgr [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75765) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 04:57:45 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] CMD "cinder-rtstool verify" returned: 0 in 0.407s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 04:57:46 devstack cinder-volume[75765]: INFO cinder.rpc [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 04:57:46 devstack cinder-volume[75765]: INFO cinder.rpc [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 04:57:46 devstack cinder-volume[75765]: WARNING stevedore.named [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 04:57:46 devstack cinder-volume[75765]: WARNING castellan.key_manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 04:57:46 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 04:57:46 devstack cinder-volume[75765]: INFO oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Starting 1 workers Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Started child 75989 {{(pid=75765) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Full set of CONF: {{(pid=75765) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] ******************************************************************************** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Configuration options gathered from: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 04:57:46 devstack cinder-volume[75989]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] ================================================================================ {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] allow_availability_zone_fallback = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] allow_compression_on_image_upload = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] allowed_direct_url_schemes = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] api_rate_limit = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] auth_strategy = keystone {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] az_cache_duration = 3600 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_availability_zone = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_host = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_stats_polling_interval = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backup_api_class = cinder.backup.api.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backup_name_template = backup-%s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backup_use_same_host = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backup_use_temp_snapshot = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] chap_password = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] chap_username = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_internal_tenant_project_id = 380cfca0ff52445d82c151c6cfe8869a {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_internal_tenant_user_id = afbe1e666b34438c83e8d213b8c5d077 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cloned_volume_same_az = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cluster = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] compression_format = gzip {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] compute_api_class = cinder.compute.nova.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] config_dir = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] config_source = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] control_exchange = openstack {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] debug = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] default_availability_zone = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] default_group_type = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] default_volume_type = lvmdriver-1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] disk_geometry = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_client_cert = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_client_cert_key = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_data_namespace = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_ssl_cert_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_ssl_cert_verify = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] driver_use_ssl = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] enable_force_upload = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] enable_new_services = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] enable_unsupported_driver = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] enforce_multipath_for_image_xfer = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] filter_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_api_insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_api_servers = ['http://192.168.122.203/image'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_api_ssl_compression = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_ca_certificates_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_catalog_info = image:glance:publicURL {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_num_retries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance_request_timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] goodness_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] graceful_shutdown_timeout = 5 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] group_api_class = cinder.group.api.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] host = devstack {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_compress_on_upload = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_conversion_address_space_limit = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_conversion_cpu_limit = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_conversion_disable = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_introspection_address_space_limit = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_introspection_cpu_limit = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_upload_use_cinder_backend = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_upload_use_internal_tenant = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_volume_cache_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_volume_cache_max_count = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] image_volume_cache_max_size_gb = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] init_host_max_objects_retrieval = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] instance_format = [instance: %(uuid)s] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iscsi_target_flags = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iscsi_write_cache = on {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iser_helper = tgtadm {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iser_ip_address = 192.168.122.203 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iser_port = 3260 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_color = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_config_append = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_dir = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_options = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_rotate_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_rotate_interval_type = days {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] log_rotation_type = none {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] max_age = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] max_logfile_count = 30 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] max_logfile_size_mb = 200 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] max_over_subscription_ratio = 20.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] message_reap_interval = 86400 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] message_ttl = 2592000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] migration_create_volume_timeout_secs = 300 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] monkey_patch = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] monkey_patch_modules = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] my_ip = 192.168.122.203 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] no_snapshot_gb_quota = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] num_iser_scan_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] num_shell_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] num_volume_device_scan_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] nvmeof_conn_info_version = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] nvmet_ns_id = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] nvmet_port_id = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_max_limit = 1000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_ext_list = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_listen_port = 8776 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_use_ssl = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] osapi_volume_workers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] per_volume_size_limit = -1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] periodic_fuzzy_delay = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] periodic_interval = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] public_endpoint = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] publish_errors = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_backup_gigabytes = 1000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_backups = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_gigabytes = 1000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_groups = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_snapshots = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] quota_volumes = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] rate_limit_burst = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] rate_limit_except_level = CRITICAL {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] rate_limit_interval = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] reinit_driver_count = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] replication_device = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] report_discard_supported = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] report_interval = 120 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] reservation_clean_interval = 86400 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] reservation_expire = 86400 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] reserved_image_namespaces = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] reserved_percentage = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] rpc_response_timeout = 120 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] run_external_periodic_tasks = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] scst_target_driver = iscsi {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] scst_target_iqn_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_down_time = 720 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] shell_completion = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] snapshot_name_template = snapshot-%s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] snapshot_same_host = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] split_loggers = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] state_path = /opt/stack/data/cinder {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] storage_availability_zone = nova {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] storage_protocol = iSCSI {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] syslog_log_facility = LOG_USER {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_helper = lioadm {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_ip_address = 192.168.122.203 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_port = 3260 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_protocol = iscsi {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] target_secondary_ip_addresses = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] trace_flags = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] transport_url = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] until_refresh = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_chap_auth = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_default_quota_class = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_journal = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_json = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_multipath_for_image_xfer = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_stderr = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] use_syslog = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] verify_glance_signatures = enabled {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_api_class = cinder.volume.api.API {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_backend_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_clear = zero {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_clear_ionice = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_clear_size = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_copy_bps_limit = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_dd_blocksize = 1M {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_name_template = volume-%s {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_service_inithost_offload = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volume_usage_audit_period = month {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] zoning_mode = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_concurrency.disable_process_locking = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.auth_section = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.auth_type = password {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.auth_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.cache = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.include_service_catalog = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.interface = public {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_password = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcache_username = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.region_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.service_type = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.203/identity {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.backend = dogpile.cache.null {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.backend_argument = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.backend_expiration_time = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.config_prefix = cache.oslo {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.debug_cache_backend = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.enable_retry_client = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.enable_socket_keepalive = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.expiration_time = 600 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.hashclient_retry_attempts = 2 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_dead_retry = 300 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_pool_maxsize = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_sasl_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.password = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.proxies = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.redis_db = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.redis_server = localhost:6379 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.retry_attempts = 2 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.retry_delay = 0.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.socket_keepalive_count = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.socket_keepalive_idle = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.socket_keepalive_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.socket_timeout = 1.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.tls_allowed_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.tls_cafile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.tls_certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.tls_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.tls_keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cache.username = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] coordination.backend_url = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.asyncio_connection = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.asyncio_slave_connection = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.backend = sqlalchemy {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.connection = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.connection_debug = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.connection_parameters = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.connection_recycle_time = 3600 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.connection_trace = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.db_inc_retry_interval = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.db_max_retries = 20 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.db_max_retry_interval = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.db_retry_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.max_overflow = 50 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.max_pool_size = 5 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.max_retries = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.mysql_wsrep_sync_wait = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.pool_timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.retry_interval = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.slave_connection = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.sqlite_synchronous = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.synchronous_reader = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] database.use_db_reconnect = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_tracing.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.connection_string = messaging:// {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.es_doc_type = notification {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.es_scroll_size = 10000 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.es_scroll_time = 2m {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.filter_error_trace = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.hmac_keys = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.sentinel_service_name = mymaster {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.socket_timeout = 0.1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.trace_requests = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler.trace_sqlalchemy = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler_jaeger.process_tags = {} {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler_jaeger.service_name_prefix = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] profiler_otlp.service_name_prefix = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.enforce_new_defaults = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.policy_default_rule = default {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.policy_file = policy.yaml {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.group = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.helper_command = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] privsep_osbrick.user = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.group = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.helper_command = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] cinder_sys_admin.user = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.auth_section = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.auth_type = password {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.cafile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.collect_timing = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.send_service_user_token = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.split_loggers = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.tls_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] service_user.tls_min_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.auth_section = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.auth_type = password {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.collect_timing = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.region_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.split_loggers = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.tls_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] glance.tls_min_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.backend_availability_zone = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.chap_password = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.chap_username = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.disk_geometry = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_client_cert = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_client_cert_key = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_data_namespace = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.driver_use_ssl = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.extra_capabilities = {} {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.filter_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.goodness_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack sudo[76039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iscsi_target_flags = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iscsi_write_cache = on {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iser_helper = tgtadm {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack sudo[76039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iser_ip_address = 192.168.122.203 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iser_port = 3260 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.lvm_share_target = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.lvm_type = auto {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.num_shell_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.replication_device = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.report_discard_supported = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.reserved_percentage = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_helper = tgtadm {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_ip_address = 192.168.122.203 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_port = 3260 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_protocol = iscsi {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.trace_flags = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.unique_fqdn_network = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.use_chap_auth = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_backend_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_clear = zero {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_clear_ionice = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_clear_size = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_reports.file_event_handler = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_reports.log_dir = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.backend_host = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.chap_password = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.chap_username = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.disk_geometry = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_client_cert = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.extra_capabilities = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.filter_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.goodness_function = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iser_helper = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iser_ip_address = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iser_port = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.lvm_share_target = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.lvm_type = auto {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.num_shell_tries = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.replication_device = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.report_discard_supported = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.reserved_percentage = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.scst_target_driver = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.storage_protocol = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_helper = lioadm {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_ip_address = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_port = 3260 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.trace_flags = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.use_chap_auth = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_clear = zero {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_clear_size = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] lvmdriver-1.volumes_dir = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_notifications.driver = [] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_notifications.retry = -1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] key_manager.fixed_key = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.barbican_api_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.barbican_endpoint = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.barbican_endpoint_type = public {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.barbican_region_name = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.cafile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.collect_timing = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.number_of_retries = 60 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.retry_delay = 1 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.send_service_user_token = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.split_loggers = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.tls_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.tls_min_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.verify_ssl = True {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican.verify_ssl_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.auth_section = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.auth_type = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.cafile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.certfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.collect_timing = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.insecure = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.keyfile = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.split_loggers = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.timeout = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.tls_ciphers = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] barbican_service_user.tls_min_version = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.approle_role_id = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.approle_secret_id = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.auth_method = approle {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.auth_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.kv_mountpoint = secret {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.kv_path = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.kv_version = 2 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.namespace = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.root_token_id = **** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.ssl_ca_crt_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.timeout = 60.0 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.token_file = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.token_role = None {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.use_ssl = False {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 04:57:46 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] ******************************************************************************** {{(pid=75765) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 04:57:46 devstack sudo[76039]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:47 devstack sudo[76132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:47 devstack sudo[76132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:47 devstack sudo[76132]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 04:57:47 devstack cinder-volume[75989]: INFO cinder.brick.local_dev.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:47 devstack sudo[76229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:47 devstack sudo[76229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:47 devstack sudo[76229]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG cinder.brick.local_dev.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75989) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 04:57:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:47 devstack sudo[76322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:47 devstack sudo[76322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:49 devstack sudo[76322]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.667s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:49 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:49 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:49 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:49 devstack sudo[76684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 04:57:49 devstack sudo[76684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:49 devstack sudo[76684]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.301s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:49 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:49 devstack sudo[76721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:49 devstack sudo[76721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:50 devstack sudo[76721]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:50 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:50 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:50 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:50 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:50 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:50 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:50 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:50 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:50 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:51 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:51 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:51 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: INFO cinder.volume.drivers.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack sudo[76747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:51 devstack sudo[76747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:51 devstack sudo[76747]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack sudo[76751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:51 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:51 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:51 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:51 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:51 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:52 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:52 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:52 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:52 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:52 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:52 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:52 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:52 devstack cinder-volume[75989]: INFO cinder.volume.driver [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG cinder.volume.driver [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75989) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_db.sqlalchemy.engines [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writer thread running {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG cinder.db.api [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Building query based on filter {{(pid=75989) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG cinder.image.image_utils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75989) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 04:57:52 devstack cinder-volume[75989]: INFO cinder.keymgr.migration [None req-40bf472d-97f1-46d1-bb6a-6ff8931b2eb5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 04:57:52 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:52 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:52 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:53 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:53 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:53 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:53 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:53 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:53 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:53 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:53 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:53 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:53 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:53 devstack cinder-volume[75989]: DEBUG cinder.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Notifying Schedulers of capabilities ... {{(pid=75989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 04:57:53 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Driver initialization completed successfully. Sep 28 04:57:53 devstack cinder-volume[75989]: INFO cinder.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Initiating service 2 cleanup Sep 28 04:57:54 devstack cinder-volume[75989]: INFO cinder.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Service 2 cleanup completed. Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG cinder.service [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Creating RPC server for service cinder-volume {{(pid=75989) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG cinder.service [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75989) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 04:57:54 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:54 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:57:54 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:54 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:54 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:54 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:54 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:54 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:54 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:57:54 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:55 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:55 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.391s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:55 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:57:55 devstack sudo[76906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:57:55 devstack sudo[76906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:57:55 devstack sudo[76906]: pam_unix(sudo:session): session closed for user root Sep 28 04:57:55 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:57:55 devstack cinder-volume[75989]: INFO cinder.volume.manager [None req-14ceb35b-ff41-4de4-b53b-dc7087ac6487 None None] Driver post RPC initialization completed successfully. Sep 28 04:57:56 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 04:58:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=3 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 04:58:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_service.periodic_task [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:58:46 devstack sudo[78690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 04:58:46 devstack sudo[78690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:58:46 devstack sudo[78690]: pam_unix(sudo:session): session closed for user root Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:58:46 devstack sudo[78693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:58:46 devstack sudo[78693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:58:46 devstack sudo[78693]: pam_unix(sudo:session): session closed for user root Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:58:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:58:46 devstack sudo[78696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 04:58:46 devstack sudo[78696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:58:47 devstack sudo[78696]: pam_unix(sudo:session): session closed for user root Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 04:58:47 devstack sudo[78699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 04:58:47 devstack sudo[78699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 04:58:47 devstack sudo[78699]: pam_unix(sudo:session): session closed for user root Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG cinder.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Notifying Schedulers of capabilities ... {{(pid=75989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG oslo_service.periodic_task [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running periodic task VolumeManager._thread_info {{(pid=75989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] thread count: 6 {{(pid=75989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 04:58:47 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] thread info: [<_MainThread(MainThread, started 137328903897216)>, , , , , ] {{(pid=75989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:00:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:00:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:UPDATE=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_service.periodic_task [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:00:46 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 05:00:46 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:00:46 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:00:46 devstack sudo[83849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 05:00:46 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:00:46 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:00:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:00:46 devstack sudo[83870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 05:00:46 devstack sudo[83870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:00:47 devstack sudo[83870]: pam_unix(sudo:session): session closed for user root Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:00:47 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 05:00:47 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:00:47 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG cinder.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Notifying Schedulers of capabilities ... {{(pid=75989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG oslo_service.periodic_task [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running periodic task VolumeManager._thread_info {{(pid=75989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] thread count: 6 {{(pid=75989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:00:47 devstack cinder-volume[75989]: DEBUG cinder.volume.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] thread info: [<_MainThread(MainThread, started 137328903897216)>, , , , , ] {{(pid=75989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_service.periodic_task [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG cinder.volume.drivers.lvm [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Updating volume stats {{(pid=75989) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:01:46 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 05:01:46 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:01:46 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:01:46 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 05:01:46 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:01:46 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:01:46 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:01:46 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 05:01:46 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:01:47 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Sep 28 05:01:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:01:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:01:47 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 05:01:47 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:01:47 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Sep 28 05:01:47 devstack cinder-volume[75989]: DEBUG oslo_concurrency.processutils [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:01:47 devstack cinder-volume[75989]: DEBUG cinder.manager [None req-d631767a-eedf-4ad9-9349-96a2f7b17629 None None] Notifying Schedulers of capabilities ... {{(pid=75989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:02:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:SELECT=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:02:05 devstack cinder-volume[75989]: DEBUG dbcounter [-] [75989] Writing DB stats cinder:UPDATE=1 {{(pid=75989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:02:22 devstack cinder-volume[75765]: INFO oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Caught SIGTERM, stopping children Sep 28 05:02:22 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Acquiring lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:22 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Acquired lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:22 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Releasing lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:22 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Stop services. {{(pid=75765) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 05:02:22 devstack cinder-volume[75765]: DEBUG oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Killing children. {{(pid=75765) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 05:02:22 devstack cinder-volume[75765]: INFO oslo_service.backend._eventlet.service [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Waiting on 1 children to exit Sep 28 05:02:27 devstack cinder-volume[75989]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 05:02:27 devstack cinder-volume[85932]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 05:02:27 devstack cinder-volume[85932]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 05:02:27 devstack cinder-volume[85932]: we strongly recommend against using it for new projects. Sep 28 05:02:27 devstack cinder-volume[85932]: If you are already using Eventlet, we recommend migrating to a different Sep 28 05:02:27 devstack cinder-volume[85932]: framework. For more detail see Sep 28 05:02:27 devstack cinder-volume[85932]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 05:02:27 devstack cinder-volume[85932]: import eventlet # noqa Sep 28 05:02:29 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Acquiring lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:29 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Acquired lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:29 devstack cinder-volume[75989]: DEBUG oslo_concurrency.lockutils [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Releasing lock "singleton_lock" {{(pid=75989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:29 devstack cinder-volume[75989]: WARNING amqp [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 05:02:29 devstack cinder-volume[75989]: WARNING amqp [None req-5c6e6660-9bac-480c-b039-e424bb2c7e84 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 05:02:29 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:29 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:29 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:30 devstack cinder-volume[85932]: INFO dbcounter [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Registered counter for database cinder Sep 28 05:02:30 devstack cinder-volume[85932]: DEBUG oslo_db.sqlalchemy.engines [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG dbcounter [-] [85932] Writer thread running {{(pid=85932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 05:02:31 devstack cinder-volume[85932]: INFO cinder.rpc [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 05:02:31 devstack cinder-volume[85932]: INFO cinder.rpc [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_db.sqlalchemy.engines [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:31 devstack cinder-volume[85932]: INFO cinder.volume.manager [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Determined volume DB was empty at startup. Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG cinder.volume.manager [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85932) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 05:02:31 devstack cinder-volume[85932]: INFO cinder.volume.manager [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 05:02:31 devstack cinder-volume[85932]: WARNING stevedore.named [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 05:02:31 devstack cinder-volume[85932]: WARNING castellan.key_manager [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 05:02:31 devstack cinder-volume[85932]: WARNING cinder.keymgr.conf_key_mgr [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 05:02:31 devstack cinder-volume[85932]: INFO cinder.volume.manager [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_db.sqlalchemy.engines [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:31 devstack cinder-volume[85932]: INFO oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Starting 1 workers Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Started child 86163 {{(pid=85932) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Full set of CONF: {{(pid=85932) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] ******************************************************************************** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Configuration options gathered from: {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] ================================================================================ {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] allow_availability_zone_fallback = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] allow_compression_on_image_upload = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] allowed_direct_url_schemes = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] api_rate_limit = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] auth_strategy = keystone {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_availability_zone = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_host = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_stats_polling_interval = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backup_api_class = cinder.backup.api.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backup_name_template = backup-%s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backup_use_same_host = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[86163]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backup_use_temp_snapshot = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] chap_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] chap_username = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_internal_tenant_project_id = 380cfca0ff52445d82c151c6cfe8869a {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_internal_tenant_user_id = afbe1e666b34438c83e8d213b8c5d077 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cluster = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] compression_format = gzip {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] compute_api_class = cinder.compute.nova.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] config_dir = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] config_source = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] control_exchange = openstack {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] debug = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] default_availability_zone = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] default_group_type = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] default_volume_type = QuobyteHD {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] disk_geometry = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_client_cert = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_client_cert_key = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_data_namespace = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_ssl_cert_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_ssl_cert_verify = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] driver_use_ssl = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] enable_new_services = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] enable_unsupported_driver = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] enabled_backends = ['QuobyteHD'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] enforce_multipath_for_image_xfer = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] filter_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_api_insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_api_servers = ['http://192.168.122.203/image'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_api_ssl_compression = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_ca_certificates_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_catalog_info = image:glance:publicURL {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_num_retries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance_request_timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] goodness_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] graceful_shutdown_timeout = 5 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] group_api_class = cinder.group.api.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] host = devstack {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_compress_on_upload = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_conversion_address_space_limit = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_conversion_cpu_limit = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_conversion_disable = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_introspection_address_space_limit = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_introspection_cpu_limit = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_upload_use_cinder_backend = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_upload_use_internal_tenant = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_volume_cache_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_volume_cache_max_count = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] image_volume_cache_max_size_gb = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] init_host_max_objects_retrieval = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] instance_format = [instance: %(uuid)s] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iscsi_target_flags = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iscsi_write_cache = on {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iser_helper = tgtadm {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iser_ip_address = 192.168.122.203 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iser_port = 3260 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_color = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_config_append = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_dir = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_options = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_rotate_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_rotate_interval_type = days {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] log_rotation_type = none {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] max_age = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] max_logfile_count = 30 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] max_logfile_size_mb = 200 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] max_over_subscription_ratio = 20.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] message_reap_interval = 86400 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] message_ttl = 2592000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] migration_create_volume_timeout_secs = 300 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] monkey_patch = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] monkey_patch_modules = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] my_ip = 192.168.122.203 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] no_snapshot_gb_quota = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] num_iser_scan_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] num_shell_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] num_volume_device_scan_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] nvmeof_conn_info_version = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] nvmet_ns_id = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] nvmet_port_id = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_max_limit = 1000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_ext_list = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_listen_port = 8776 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_use_ssl = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] osapi_volume_workers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] per_volume_size_limit = -1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] periodic_fuzzy_delay = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] periodic_interval = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] public_endpoint = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] publish_errors = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_backup_gigabytes = 1000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_backups = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_gigabytes = 1000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_groups = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_snapshots = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] quota_volumes = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] rate_limit_burst = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] rate_limit_except_level = CRITICAL {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] rate_limit_interval = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] reinit_driver_count = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] replication_device = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] report_discard_supported = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] report_interval = 120 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] reservation_clean_interval = 86400 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] reservation_expire = 86400 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] reserved_image_namespaces = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] reserved_percentage = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] rpc_response_timeout = 120 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] run_external_periodic_tasks = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] scst_target_driver = iscsi {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] scst_target_iqn_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_down_time = 720 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] shell_completion = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] snapshot_name_template = snapshot-%s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] split_loggers = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] state_path = /opt/stack/data/cinder {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] storage_availability_zone = nova {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] storage_protocol = iSCSI {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] syslog_log_facility = LOG_USER {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_helper = lioadm {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_ip_address = 192.168.122.203 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_port = 3260 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_protocol = iscsi {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] target_secondary_ip_addresses = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] trace_flags = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[86163]: INFO cinder.volume.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] transport_url = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.remotefs [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86163) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] until_refresh = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_chap_auth = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_default_quota_class = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_journal = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_json = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_multipath_for_image_xfer = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_stderr = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] use_syslog = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] verify_glance_signatures = enabled {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_api_class = cinder.volume.api.API {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_backend_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_clear = zero {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_clear_ionice = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_clear_size = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_copy_bps_limit = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_dd_blocksize = 1M {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_name_template = volume-%s {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_service_inithost_offload = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volume_usage_audit_period = month {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] zoning_mode = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_concurrency.disable_process_locking = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.auth_section = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.auth_type = password {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.auth_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.cache = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.include_service_catalog = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.interface = public {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcache_username = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.region_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.service_type = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.203/identity {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.backend = dogpile.cache.null {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.backend_argument = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.backend_expiration_time = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.config_prefix = cache.oslo {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.debug_cache_backend = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.enable_retry_client = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.enable_socket_keepalive = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.expiration_time = 600 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.hashclient_retry_attempts = 2 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_dead_retry = 300 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_pool_maxsize = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_sasl_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.proxies = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.redis_db = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.redis_server = localhost:6379 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.retry_attempts = 2 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.retry_delay = 0.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.socket_keepalive_count = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.socket_keepalive_idle = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.socket_keepalive_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.socket_timeout = 1.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.tls_allowed_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.tls_cafile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.tls_certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.tls_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.tls_keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cache.username = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] coordination.backend_url = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.asyncio_connection = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.asyncio_slave_connection = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.backend = sqlalchemy {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.connection = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.connection_debug = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.connection_parameters = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.connection_recycle_time = 3600 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.connection_trace = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.db_inc_retry_interval = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.db_max_retries = 20 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.db_max_retry_interval = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.db_retry_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.max_overflow = 50 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.max_pool_size = 5 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.max_retries = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.mysql_wsrep_sync_wait = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.pool_timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.retry_interval = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.slave_connection = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.sqlite_synchronous = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.synchronous_reader = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] database.use_db_reconnect = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_tracing.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.connection_string = messaging:// {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.es_doc_type = notification {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.es_scroll_size = 10000 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.es_scroll_time = 2m {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.filter_error_trace = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.hmac_keys = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.sentinel_service_name = mymaster {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.socket_timeout = 0.1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.trace_requests = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler.trace_sqlalchemy = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler_jaeger.process_tags = {} {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler_jaeger.service_name_prefix = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] profiler_otlp.service_name_prefix = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.enforce_new_defaults = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.policy_default_rule = default {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.policy_file = policy.yaml {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_policy.remote_timeout = 60.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.group = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.helper_command = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] privsep_osbrick.user = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.group = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.helper_command = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] cinder_sys_admin.user = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.auth_section = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.auth_type = password {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.cafile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.collect_timing = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.send_service_user_token = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.split_loggers = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.tls_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] service_user.tls_min_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.auth_section = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.auth_type = password {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.collect_timing = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.region_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.split_loggers = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.tls_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] glance.tls_min_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.backend_availability_zone = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.chap_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.chap_username = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86163) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 05:02:31 devstack cinder-volume[86163]: WARNING cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 05:02:31 devstack cinder-volume[86163]: WARNING cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Running cmd (subprocess): mount.quobyte {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.disk_geometry = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_client_cert = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_client_cert_key = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_data_namespace = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.driver_use_ssl = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.extra_capabilities = {} {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.filter_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.goodness_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iscsi_target_flags = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iscsi_write_cache = on {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iser_helper = tgtadm {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iser_ip_address = 192.168.122.203 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iser_port = 3260 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_host = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_login = admin {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_mount_options = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_private_key = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_share_path = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_ssh_port = 22 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.num_shell_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.quobyte_volume_url = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.replication_device = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.report_discard_supported = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.reserved_percentage = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_helper = tgtadm {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_ip_address = 192.168.122.203 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_port = 3260 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_protocol = iscsi {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.trace_flags = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.unique_fqdn_network = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.use_chap_auth = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_backend_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_clear = zero {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_clear_ionice = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_clear_size = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_reports.file_event_handler = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_reports.log_dir = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.backend_availability_zone = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.backend_host = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.chap_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.chap_username = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.chiscsi_conf = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.disk_geometry = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_client_cert = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_data_namespace = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.driver_use_ssl = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.extra_capabilities = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.filter_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.goodness_function = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iscsi_target_flags = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iscsi_write_cache = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iser_helper = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iser_ip_address = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iser_port = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.iser_target_prefix = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86163) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:31 devstack cinder-volume[86163]: INFO cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 ... Sep 28 05:02:31 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 -c /etc/quobyte/client-cinder.cfg {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_host = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_login = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_mount_options = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_password = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_private_key = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_share_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_ssh_port = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.num_shell_tries = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nvmet_ns_id = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.nvmet_port_id = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 -c /etc/quobyte/client-cinder.cfg Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.replication_device = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.report_discard_supported = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.reserved_percentage = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.scst_target_driver = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.storage_protocol = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_helper = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_ip_address = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_port = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_prefix = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_protocol = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.trace_flags = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.unique_fqdn_network = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.use_chap_auth = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_clear = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_clear_ionice = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_clear_size = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] QuobyteHD.volumes_dir = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_notifications.driver = [] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_notifications.retry = -1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] key_manager.fixed_key = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.barbican_api_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.barbican_endpoint = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.barbican_endpoint_type = public {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.barbican_region_name = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.cafile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.collect_timing = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.number_of_retries = 60 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.retry_delay = 1 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.send_service_user_token = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.split_loggers = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.tls_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.tls_min_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.verify_ssl = True {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican.verify_ssl_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.auth_section = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.auth_type = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.cafile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.certfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.collect_timing = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.insecure = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.keyfile = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.split_loggers = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.timeout = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.tls_ciphers = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] barbican_service_user.tls_min_version = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.approle_role_id = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.approle_secret_id = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.auth_method = approle {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.auth_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.kv_mountpoint = secret {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.kv_path = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.kv_version = 2 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.namespace = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.root_token_id = **** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.ssl_ca_crt_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.timeout = 60.0 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.token_file = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.token_role = None {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.use_ssl = False {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:31 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] ******************************************************************************** {{(pid=85932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 05:02:32 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.483s {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 succeeded Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86163) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.497s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:32 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:32 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:32 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.243s {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.volume.driver [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Driver hasn't implemented _init_vendor_properties() Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.volume.driver [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1707000732422, 'free_capacity_gb': 1775.1707000732422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86163) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_db.sqlalchemy.engines [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86163) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG dbcounter [-] [86163] Writer thread running {{(pid=86163) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.db.api [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Building query based on filter {{(pid=86163) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.image.image_utils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86163) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.keymgr.migration [None req-21804b45-1823-4466-8439-04c512f9116c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86163) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86163) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:32 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:32 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:32 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.247s {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Notifying Schedulers of capabilities ... {{(pid=86163) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.volume.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Driver initialization completed successfully. Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Initiating service 3 cleanup Sep 28 05:02:32 devstack cinder-volume[86163]: INFO cinder.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Service 3 cleanup completed. Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.service [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Creating RPC server for service cinder-volume {{(pid=86163) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 05:02:32 devstack cinder-volume[86163]: DEBUG cinder.service [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86163) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 05:02:33 devstack cinder-volume[86163]: INFO cinder.volume.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86163) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG cinder.volume.drivers.quobyte [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86163) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86163) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:33 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:33 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:33 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:33 devstack cinder-volume[86163]: DEBUG oslo_concurrency.processutils [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.271s {{(pid=86163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:33 devstack cinder-volume[86163]: INFO cinder.volume.manager [None req-3f879a57-31e2-466f-ac91-19c2dc07eecc None None] Driver post RPC initialization completed successfully. Sep 28 05:02:36 devstack cinder-volume[85932]: INFO oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Caught SIGTERM, stopping children Sep 28 05:02:36 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Acquiring lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:36 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Acquired lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:36 devstack cinder-volume[85932]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Releasing lock "singleton_lock" {{(pid=85932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:36 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Stop services. {{(pid=85932) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 05:02:36 devstack cinder-volume[85932]: DEBUG oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Killing children. {{(pid=85932) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 05:02:36 devstack cinder-volume[85932]: INFO oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Waiting on 1 children to exit Sep 28 05:02:37 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Acquiring lock "singleton_lock" {{(pid=86163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:37 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Acquired lock "singleton_lock" {{(pid=86163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:37 devstack cinder-volume[86163]: DEBUG oslo_concurrency.lockutils [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Releasing lock "singleton_lock" {{(pid=86163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:37 devstack cinder-volume[86163]: WARNING amqp [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 05:02:37 devstack cinder-volume[86163]: WARNING amqp [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 05:02:37 devstack cinder-volume[85932]: INFO oslo_service.backend._eventlet.service [None req-3f053e05-064f-47b4-b441-9d20eb71bd5e None None] Child 86163 exited with status 0 Sep 28 05:02:37 devstack cinder-volume[86542]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 05:02:37 devstack cinder-volume[86542]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 05:02:37 devstack cinder-volume[86542]: we strongly recommend against using it for new projects. Sep 28 05:02:37 devstack cinder-volume[86542]: If you are already using Eventlet, we recommend migrating to a different Sep 28 05:02:37 devstack cinder-volume[86542]: framework. For more detail see Sep 28 05:02:37 devstack cinder-volume[86542]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 05:02:37 devstack cinder-volume[86542]: import eventlet # noqa Sep 28 05:02:40 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 05:02:40 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 05:02:40 devstack cinder-volume[86542]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86542) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 05:02:41 devstack cinder-volume[86542]: INFO dbcounter [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Registered counter for database cinder Sep 28 05:02:41 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG dbcounter [-] [86542] Writer thread running {{(pid=86542) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 05:02:42 devstack cinder-volume[86542]: INFO cinder.rpc [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 05:02:42 devstack cinder-volume[86542]: INFO cinder.rpc [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:42 devstack cinder-volume[86542]: INFO cinder.volume.manager [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Determined volume DB was empty at startup. Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG cinder.volume.manager [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86542) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 05:02:42 devstack cinder-volume[86542]: WARNING stevedore.named [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 05:02:42 devstack cinder-volume[86542]: WARNING castellan.key_manager [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 05:02:42 devstack cinder-volume[86542]: WARNING cinder.keymgr.conf_key_mgr [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 05:02:42 devstack cinder-volume[86542]: INFO cinder.volume.manager [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_db.sqlalchemy.engines [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86542) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:42 devstack cinder-volume[86542]: INFO oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Starting 1 workers Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Started child 86815 {{(pid=86542) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Full set of CONF: {{(pid=86542) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] ******************************************************************************** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] Configuration options gathered from: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] ================================================================================ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] allow_availability_zone_fallback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] allow_compression_on_image_upload = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] allowed_direct_url_schemes = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] api_rate_limit = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86815]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] auth_strategy = keystone {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_host = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_stats_polling_interval = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backup_api_class = cinder.backup.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backup_name_template = backup-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backup_use_same_host = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backup_use_temp_snapshot = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] chap_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] chap_username = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_internal_tenant_project_id = 380cfca0ff52445d82c151c6cfe8869a {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_internal_tenant_user_id = afbe1e666b34438c83e8d213b8c5d077 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cluster = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] compression_format = gzip {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] compute_api_class = cinder.compute.nova.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] config_dir = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] config_source = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] control_exchange = openstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] debug = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] default_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] default_group_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] default_volume_type = QuobyteHD {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] disk_geometry = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_client_cert = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_client_cert_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_data_namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_ssl_cert_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_ssl_cert_verify = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] driver_use_ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] enable_new_services = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] enable_unsupported_driver = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] enabled_backends = ['QuobyteHD'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] enforce_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] filter_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_api_insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_api_servers = ['http://192.168.122.203/image'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_api_ssl_compression = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_ca_certificates_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_catalog_info = image:glance:publicURL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_num_retries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance_request_timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] goodness_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] graceful_shutdown_timeout = 5 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] group_api_class = cinder.group.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] host = devstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_compress_on_upload = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_conversion_address_space_limit = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_conversion_cpu_limit = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_conversion_disable = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_introspection_address_space_limit = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_introspection_cpu_limit = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_upload_use_cinder_backend = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_upload_use_internal_tenant = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_volume_cache_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_volume_cache_max_count = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] image_volume_cache_max_size_gb = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] init_host_max_objects_retrieval = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] instance_format = [instance: %(uuid)s] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iscsi_target_flags = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iscsi_write_cache = on {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iser_helper = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iser_ip_address = 192.168.122.203 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iser_port = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_color = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 05:02:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86815) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_config_append = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_dir = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_options = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_rotate_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_rotate_interval_type = days {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] log_rotation_type = none {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] max_age = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] max_logfile_count = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] max_logfile_size_mb = 200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] max_over_subscription_ratio = 20.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] message_reap_interval = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] message_ttl = 2592000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] migration_create_volume_timeout_secs = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] monkey_patch = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] monkey_patch_modules = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] my_ip = 192.168.122.203 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] no_snapshot_gb_quota = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] num_iser_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] num_shell_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] num_volume_device_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] nvmeof_conn_info_version = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] nvmet_ns_id = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] nvmet_port_id = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_max_limit = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_ext_list = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_listen_port = 8776 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_use_ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] osapi_volume_workers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] per_volume_size_limit = -1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] periodic_fuzzy_delay = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] periodic_interval = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] public_endpoint = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] publish_errors = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_backup_gigabytes = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_backups = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_gigabytes = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_groups = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_snapshots = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] quota_volumes = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] rate_limit_burst = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] rate_limit_except_level = CRITICAL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] rate_limit_interval = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] reinit_driver_count = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] replication_device = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] report_discard_supported = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] report_interval = 120 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] reservation_clean_interval = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] reservation_expire = 86400 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] reserved_image_namespaces = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] reserved_percentage = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] rpc_response_timeout = 120 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] run_external_periodic_tasks = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] scst_target_driver = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] scst_target_iqn_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_down_time = 720 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] shell_completion = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] snapshot_name_template = snapshot-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] state_path = /opt/stack/data/cinder {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] storage_availability_zone = nova {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] storage_protocol = iSCSI {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] syslog_log_facility = LOG_USER {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_helper = lioadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_ip_address = 192.168.122.203 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_port = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_protocol = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] target_secondary_ip_addresses = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] trace_flags = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] transport_url = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] until_refresh = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_chap_auth = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_default_quota_class = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_journal = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_json = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_stderr = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] use_syslog = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] verify_glance_signatures = enabled {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_api_class = cinder.volume.api.API {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_backend_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_clear = zero {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_clear_ionice = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_clear_size = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_copy_bps_limit = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_dd_blocksize = 1M {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_name_template = volume-%s {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_service_inithost_offload = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volume_usage_audit_period = month {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] zoning_mode = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_concurrency.disable_process_locking = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.auth_type = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.auth_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.cache = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.include_service_catalog = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.interface = public {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcache_username = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.region_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.service_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.203/identity {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.backend = dogpile.cache.null {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.backend_argument = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.backend_expiration_time = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.config_prefix = cache.oslo {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.debug_cache_backend = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.enable_retry_client = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.enable_socket_keepalive = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.expiration_time = 600 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.hashclient_retry_attempts = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_dead_retry = 300 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_pool_maxsize = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_sasl_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.proxies = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.redis_db = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.redis_server = localhost:6379 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.retry_attempts = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.retry_delay = 0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.socket_keepalive_count = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86815) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 05:02:42 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 05:02:42 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.socket_keepalive_idle = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.socket_keepalive_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.socket_timeout = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.tls_allowed_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.tls_cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.tls_certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.tls_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.tls_keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cache.username = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] coordination.backend_url = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.asyncio_connection = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Running cmd (subprocess): mount.quobyte {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.asyncio_slave_connection = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.backend = sqlalchemy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.connection = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.connection_debug = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.connection_parameters = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.connection_recycle_time = 3600 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.connection_trace = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.db_inc_retry_interval = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.db_max_retries = 20 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.db_max_retry_interval = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.db_retry_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.max_overflow = 50 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.max_pool_size = 5 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.max_retries = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.mysql_wsrep_sync_wait = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.pool_timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.retry_interval = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.slave_connection = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.sqlite_synchronous = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.synchronous_reader = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] database.use_db_reconnect = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack quobyte-client[86837]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_tracing.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.connection_string = messaging:// {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack quobyte-client[86837]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.es_doc_type = notification {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.es_scroll_size = 10000 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.es_scroll_time = 2m {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.filter_error_trace = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.hmac_keys = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.sentinel_service_name = mymaster {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.socket_timeout = 0.1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.trace_requests = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler.trace_sqlalchemy = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler_jaeger.process_tags = {} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler_jaeger.service_name_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] profiler_otlp.service_name_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.enforce_new_defaults = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.policy_default_rule = default {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.policy_file = policy.yaml {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.group = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.helper_command = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] privsep_osbrick.user = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.group = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.helper_command = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] cinder_sys_admin.user = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.auth_type = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.collect_timing = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.send_service_user_token = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.tls_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] service_user.tls_min_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.auth_type = password {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.collect_timing = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.region_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.tls_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] glance.tls_min_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.backend_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.chap_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.chap_username = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.disk_geometry = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_client_cert = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_client_cert_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_data_namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.driver_use_ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.extra_capabilities = {} {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.filter_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.goodness_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iscsi_target_flags = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iscsi_write_cache = on {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iser_helper = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iser_ip_address = 192.168.122.203 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iser_port = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_host = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_login = admin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_mount_options = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_private_key = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_share_path = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.num_shell_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.quobyte_volume_url = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.replication_device = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.report_discard_supported = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.reserved_percentage = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_helper = tgtadm {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_ip_address = 192.168.122.203 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_port = 3260 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_protocol = iscsi {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.trace_flags = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.unique_fqdn_network = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.use_chap_auth = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_backend_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_clear = zero {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_clear_ionice = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_clear_size = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_reports.file_event_handler = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_reports.log_dir = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.backend_availability_zone = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.backend_host = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.chap_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.chap_username = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.chiscsi_conf = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.disk_geometry = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_client_cert = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_data_namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:42 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.driver_use_ssl = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.extra_capabilities = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.filter_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.goodness_function = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iser_helper = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iser_ip_address = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iser_port = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.iser_target_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_host = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_login = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_mount_options = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_password = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_private_key = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_share_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_ssh_port = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.num_shell_tries = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.nvmet_port_id = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.replication_device = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.report_discard_supported = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.reserved_percentage = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.scst_target_driver = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.storage_protocol = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_helper = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_ip_address = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_port = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_prefix = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_protocol = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.trace_flags = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.use_chap_auth = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_clear = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_clear_size = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] QuobyteHD.volumes_dir = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_notifications.driver = [] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_notifications.retry = -1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] key_manager.fixed_key = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.barbican_api_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.barbican_endpoint = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.barbican_endpoint_type = public {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.barbican_region_name = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.collect_timing = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.number_of_retries = 60 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.retry_delay = 1 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.send_service_user_token = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.tls_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.tls_min_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.verify_ssl = True {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican.verify_ssl_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.auth_section = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.auth_type = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.cafile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.certfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.collect_timing = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.insecure = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.keyfile = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.split_loggers = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.timeout = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.tls_ciphers = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] barbican_service_user.tls_min_version = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.approle_role_id = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.approle_secret_id = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.auth_method = approle {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.auth_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.kv_mountpoint = secret {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.kv_path = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.kv_version = 2 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.namespace = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.root_token_id = **** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.ssl_ca_crt_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.timeout = 60.0 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.token_file = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.token_role = None {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.use_ssl = False {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 05:02:43 devstack cinder-volume[86542]: DEBUG oslo_service.backend._eventlet.service [None req-874ba33a-1a35-4107-857e-46229dcd0872 None None] ******************************************************************************** {{(pid=86542) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 05:02:43 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.volume.driver [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Driver hasn't implemented _init_vendor_properties() Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.driver [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1707000732422, 'free_capacity_gb': 1775.1707000732422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86815) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writer thread running {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.db.api [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Building query based on filter {{(pid=86815) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86815) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.keymgr.migration [None req-8c8c8e46-8910-4bb6-939d-31676fa8acc0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 05:02:43 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:43 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:43 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.427s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Driver initialization completed successfully. Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Initiating service 3 cleanup Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Service 3 cleanup completed. Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.service [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Creating RPC server for service cinder-volume {{(pid=86815) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.service [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86815) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 05:02:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:02:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:02:43 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:02:43 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:02:44 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Sep 28 05:02:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.388s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:02:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9aee436f-05f4-478d-af22-7af08a818cce None None] Driver post RPC initialization completed successfully. Sep 28 05:02:52 devstack cinder-volume[86542]: DEBUG dbcounter [-] [86542] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86542) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:02:53 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:02:54 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:03:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:03:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 6 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:03:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Flow 'volume_create_manager' (9511314c-1c95-44e8-9d79-4ec31257de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f6883c-e1b7-4a7b-aa2b-2af0c91ed2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f6883c-e1b7-4a7b-aa2b-2af0c91ed2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-990724478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e9fcd1-0144-40c8-9792-b950fc977069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9436ff1c414746529cadc97afa464ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:05Z,use_quota=True,user_id='0ce0b79b5b6a49d3bfd159ffc514ebc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cfbd6-fb05-4c50-b3ff-c6b10b56ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cfbd6-fb05-4c50-b3ff-c6b10b56ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d3327f-ddb9-42b1-acb3-64df92840355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d3327f-ddb9-42b1-acb3-64df92840355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e9fcd1-0144-40c8-9792-b950fc977069', 'volume_name': 'volume-98e9fcd1-0144-40c8-9792-b950fc977069', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3c4330-e533-40d8-8c1e-a09d2536d8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3c4330-e533-40d8-8c1e-a09d2536d8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb10387-2004-46b5-8a04-9efc1ddd9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Volume 98e9fcd1-0144-40c8-9792-b950fc977069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e9fcd1-0144-40c8-9792-b950fc977069', 'volume_size': 1} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-990724478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e9fcd1-0144-40c8-9792-b950fc977069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9436ff1c414746529cadc97afa464ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:05Z,use_quota=True,user_id='0ce0b79b5b6a49d3bfd159ffc514ebc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Creating volume 98e9fcd1-0144-40c8-9792-b950fc977069 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:04:06 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:04:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:06 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 1073741824 Sep 28 05:04:06 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Flow 'volume_create_manager' (58e19f6c-3f8b-4f6d-aab3-eb34314335e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a974d4-4479-4262-9b05-8afb1d023d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a974d4-4479-4262-9b05-8afb1d023d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-142770527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3573cf4-f91b-49b5-81e5-943178789663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0a5523080440e0bbbdd6a92d2d4e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:07Z,use_quota=True,user_id='9fb5931c588745d3bffe2a6b0c48132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9550f050-ff18-4a3f-b92f-835d90ae7886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9550f050-ff18-4a3f-b92f-835d90ae7886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2276e70-dd6d-4689-999b-84843ef831be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2276e70-dd6d-4689-999b-84843ef831be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3573cf4-f91b-49b5-81e5-943178789663', 'volume_name': 'volume-a3573cf4-f91b-49b5-81e5-943178789663', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8c68d4-7201-443b-bcd6-55600ef38eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8c68d4-7201-443b-bcd6-55600ef38eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b347b02c-050b-4926-8f77-cccfe6ba1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Volume a3573cf4-f91b-49b5-81e5-943178789663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3573cf4-f91b-49b5-81e5-943178789663', 'volume_size': 1} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:07 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 1073741824" returned: 0 in 1.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:07 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 Sep 28 05:04:07 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:08 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069" returned: 0 in 0.632s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-142770527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3573cf4-f91b-49b5-81e5-943178789663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0a5523080440e0bbbdd6a92d2d4e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:07Z,use_quota=True,user_id='9fb5931c588745d3bffe2a6b0c48132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Creating volume a3573cf4-f91b-49b5-81e5-943178789663 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:04:08 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb10387-2004-46b5-8a04-9efc1ddd9c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e9fcd1-0144-40c8-9792-b950fc977069', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:08 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 1073741824 Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c5a9c6-bf65-4e38-8dff-d62dfc3aef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:08 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Volume volume-98e9fcd1-0144-40c8-9792-b950fc977069 (98e9fcd1-0144-40c8-9792-b950fc977069): created successfully Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c5a9c6-bf65-4e38-8dff-d62dfc3aef05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Flow 'volume_create_manager' (9511314c-1c95-44e8-9d79-4ec31257de94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5d448559-b2f3-48ac-ad13-068e9ee84df7 tempest-DeleteServersTestJSON-800071046 None] Created volume successfully. Sep 28 05:04:09 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 1073741824" returned: 0 in 0.811s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:09 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 Sep 28 05:04:09 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:09 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663" returned: 0 in 0.651s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b347b02c-050b-4926-8f77-cccfe6ba1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3573cf4-f91b-49b5-81e5-943178789663', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703e1254-195f-447b-9811-1a73cc8fa133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Volume volume-a3573cf4-f91b-49b5-81e5-943178789663 (a3573cf4-f91b-49b5-81e5-943178789663): created successfully Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703e1254-195f-447b-9811-1a73cc8fa133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Flow 'volume_create_manager' (58e19f6c-3f8b-4f6d-aab3-eb34314335e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a1a6aa37-ba89-43fa-a21b-cfc0d27e24c1 tempest-VolumesAdminNegativeTest-1486780971 None] Created volume successfully. Sep 28 05:04:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Acquiring lock "cinder-a3573cf4-f91b-49b5-81e5-943178789663-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "cinder-a3573cf4-f91b-49b5-81e5-943178789663-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Acquiring lock "cinder-quobyte-a3573cf4-f91b-49b5-81e5-943178789663" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "cinder-quobyte-a3573cf4-f91b-49b5-81e5-943178789663" acquired by "delete_volume" :: waited 0.045s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:11 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx0q7mp_c/privsep.sock'] Sep 28 05:04:11 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx0q7mp_c/privsep.sock Sep 28 05:04:11 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 05:04:13 devstack cinder-volume[86815]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 05:04:14 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:14 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Spawned new privsep daemon via rootwrap Sep 28 05:04:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Accepted privsep connection to /tmp/tmpx0q7mp_c/privsep.sock {{(pid=86815) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 05:04:14 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 05:04:14 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 05:04:14 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 05:04:14 devstack cinder-volume[86815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87997 Sep 28 05:04:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bccb898-f34e-4d7c-987d-d8ff0f629e43]: (2,) {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6adb71-1c73-4cae-a675-7167352dee21]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:14 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 Sep 28 05:04:14 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:15 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663" returned: 0 in 0.773s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:15 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663 Sep 28 05:04:15 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:15 devstack cinder-volume[86815]: WARNING py.warnings [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 05:04:15 devstack cinder-volume[86815]: .first() Sep 28 05:04:15 devstack cinder-volume[86815]: Sep 28 05:04:15 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a3573cf4-f91b-49b5-81e5-943178789663" returned: 0 in 0.426s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "cinder-quobyte-a3573cf4-f91b-49b5-81e5-943178789663" released by "delete_volume" :: held 4.194s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.120s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-98e9fcd1-0144-40c8-9792-b950fc977069', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00c6c818-5d31-4c66-b317-060c26abeb5a', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:04:15 devstack cinder-volume[86815]: WARNING cinder.quota [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:04:15 devstack cinder-volume[86815]: WARNING cinder.quota [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Created reservations ['bd6c1462-5e59-4623-900d-14bf3f186642', '5d34f869-4742-45ae-8162-2240d78063d1', 'f74069b3-d626-4e06-ae7d-2457abd02eef', 'ac77f34f-7e29-4561-91da-7a729a2f4fa3'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-b4b984c0-9d9f-4687-a7a0-74732187d21b req-e113855c-58fe-45c6-91ab-96ef9e7e2e65 tempest-DeleteServersTestJSON-800071046 None] attachment_update completed successfully. Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:16 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:04:16 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:16 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.603s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:16 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:04:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Deleted volume successfully. Sep 28 05:04:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b547d5f-6e0f-4dd4-b940-10af148a2d74 tempest-VolumesAdminNegativeTest-1486780971 None] Lock "cinder-a3573cf4-f91b-49b5-81e5-943178789663-delete_volume" released by "delete_volume" :: held 5.772s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:22 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-75977911-4fb9-4cbd-9285-0cda6da9924a req-af4ef7bc-6992-45cc-933f-8bef95680755 tempest-DeleteServersTestJSON-800071046 None] Terminate volume connection completed successfully. Sep 28 05:04:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-75977911-4fb9-4cbd-9285-0cda6da9924a req-af4ef7bc-6992-45cc-933f-8bef95680755 tempest-DeleteServersTestJSON-800071046 None] Deleting attachment 00c6c818-5d31-4c66-b317-060c26abeb5a. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Flow 'volume_create_manager' (0062fd7a-0796-4e40-b7b7-674639b9fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79183299-07c1-4c4b-8335-9a1fd5f9770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79183299-07c1-4c4b-8335-9a1fd5f9770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-458941309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e446d4a0-612c-44c0-a405-bbe4d77c3c93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c37b3efcf014b0daa5c9a2b05785812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:23Z,use_quota=True,user_id='73b797e37a00426dbcfde6014ccdf04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa91eb-03fc-4149-9390-eef00d00dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa91eb-03fc-4149-9390-eef00d00dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cca6c6-409c-4dcd-b0d6-e89a7656b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cca6c6-409c-4dcd-b0d6-e89a7656b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e446d4a0-612c-44c0-a405-bbe4d77c3c93', 'volume_name': 'volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a4b3e3-37f7-49d5-a872-dc764bfa5e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a4b3e3-37f7-49d5-a872-dc764bfa5e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e31f5d-f6c5-4f5a-b4cd-9aa1dbec2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Volume e446d4a0-612c-44c0-a405-bbe4d77c3c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93', 'volume_size': 1} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-458941309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e446d4a0-612c-44c0-a405-bbe4d77c3c93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c37b3efcf014b0daa5c9a2b05785812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:23Z,use_quota=True,user_id='73b797e37a00426dbcfde6014ccdf04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Creating volume e446d4a0-612c-44c0-a405-bbe4d77c3c93 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:04:23 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:23 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 1073741824 Sep 28 05:04:23 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "cinder-98e9fcd1-0144-40c8-9792-b950fc977069-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "cinder-98e9fcd1-0144-40c8-9792-b950fc977069-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "cinder-quobyte-98e9fcd1-0144-40c8-9792-b950fc977069" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "cinder-quobyte-98e9fcd1-0144-40c8-9792-b950fc977069" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34fc96-2314-43e6-a86d-4b5abb400af1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:23 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 Sep 28 05:04:23 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:24 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 1073741824" returned: 0 in 0.535s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:24 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:24 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 Sep 28 05:04:24 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:24 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069 Sep 28 05:04:24 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:24 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e31f5d-f6c5-4f5a-b4cd-9aa1dbec2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be497c2d-e617-4d3c-86e5-11fe2a02704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:24 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Volume volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 (e446d4a0-612c-44c0-a405-bbe4d77c3c93): created successfully Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be497c2d-e617-4d3c-86e5-11fe2a02704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Flow 'volume_create_manager' (0062fd7a-0796-4e40-b7b7-674639b9fecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-98e9fcd1-0144-40c8-9792-b950fc977069" returned: 0 in 0.337s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "cinder-quobyte-98e9fcd1-0144-40c8-9792-b950fc977069" released by "delete_volume" :: held 0.801s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-5021826a-3e44-4c1a-b153-60e2aa69371f req-77c1b1dc-e386-4088-ac24-551c8f83cac6 tempest-VolumesGetTestJSON-1135858613 None] Created volume successfully. Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Created reservations ['a8e120b7-bf1b-47dc-aac8-a0f891e5f23a', 'dc71d589-7c49-4dac-aaf9-3908d227053d', 'e9537876-503b-49e3-bb82-52b1b9ce300d', 'cf5eb229-1ae4-4d06-8d94-752f50513ed9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:24 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:04:24 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:24 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.256s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:04:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Deleted volume successfully. Sep 28 05:04:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5df33563-94b2-44bf-9f9a-7a193da990ef tempest-DeleteServersTestJSON-800071046 None] Lock "cinder-98e9fcd1-0144-40c8-9792-b950fc977069-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Acquiring lock "cinder-e446d4a0-612c-44c0-a405-bbe4d77c3c93-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "cinder-e446d4a0-612c-44c0-a405-bbe4d77c3c93-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Acquiring lock "cinder-quobyte-e446d4a0-612c-44c0-a405-bbe4d77c3c93" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "cinder-quobyte-e446d4a0-612c-44c0-a405-bbe4d77c3c93" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5424811a-6150-4569-8e99-f3dc372f8e71]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:26 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 Sep 28 05:04:26 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:26 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:26 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93 Sep 28 05:04:26 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:26 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e446d4a0-612c-44c0-a405-bbe4d77c3c93" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "cinder-quobyte-e446d4a0-612c-44c0-a405-bbe4d77c3c93" released by "delete_volume" :: held 0.835s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG cinder.quota [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Created reservations ['58d8d1bf-9f26-4fe4-b87c-561a8935a9d5', '8f87a793-9ed6-4158-a026-50279a804f1f', '671624c7-97e3-45e9-b737-b714d49eace9', 'cfd95005-ee85-44bb-b3c1-3c13c655f79e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:27 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:04:27 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:27 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG cinder.manager [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:04:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Deleted volume successfully. Sep 28 05:04:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-78348c86-85f9-4128-9196-76146e0288b4 req-1f789113-20d0-497e-a340-fa6dc11e7556 tempest-VolumesGetTestJSON-1135858613 None] Lock "cinder-e446d4a0-612c-44c0-a405-bbe4d77c3c93-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:29 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:04:29 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:29 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 8 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:04:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:04:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-444e0ed4-5538-43df-a05d-f4212e6e2f17 tempest-BackendsCapabilitiesAdminTestsJSON-427693042 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1707000732422, 'free_capacity_gb': 1775.1707000732422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86815) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 05:04:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2de650a0-7b13-418a-8a7d-b3f06569e0b4 tempest-BackendsCapabilitiesAdminTestsJSON-427693042 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1707000732422, 'free_capacity_gb': 1775.1707000732422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86815) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Flow 'volume_create_manager' (a73c2169-aeac-45bb-872e-919709d0ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e57440d-f8c9-4259-95e2-67165a95583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e57440d-f8c9-4259-95e2-67165a95583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1826016286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0ea1e3-ead0-4028-8055-08ba07f14948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ee70e2de49daabeacd103e2adecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:36Z,use_quota=True,user_id='73976f7c294748bf8237414cfe94c6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51621033-c85b-4647-9cea-5e52c6c96292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51621033-c85b-4647-9cea-5e52c6c96292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df00287e-c536-484a-b8f2-0010eb6eb9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df00287e-c536-484a-b8f2-0010eb6eb9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0ea1e3-ead0-4028-8055-08ba07f14948', 'volume_name': 'volume-3b0ea1e3-ead0-4028-8055-08ba07f14948', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d674446b-946b-4415-9c91-fe05284d9930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d674446b-946b-4415-9c91-fe05284d9930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6663848a-e306-469c-880b-a8b057941be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:36 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Volume 3b0ea1e3-ead0-4028-8055-08ba07f14948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0ea1e3-ead0-4028-8055-08ba07f14948', 'volume_size': 1} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1826016286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0ea1e3-ead0-4028-8055-08ba07f14948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c7ee70e2de49daabeacd103e2adecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:36Z,use_quota=True,user_id='73976f7c294748bf8237414cfe94c6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Creating volume 3b0ea1e3-ead0-4028-8055-08ba07f14948 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:04:36 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:36 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 1073741824 Sep 28 05:04:36 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:36 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 1073741824" returned: 0 in 0.582s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:36 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 Sep 28 05:04:36 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:37 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948" returned: 0 in 0.347s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6663848a-e306-469c-880b-a8b057941be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0ea1e3-ead0-4028-8055-08ba07f14948', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f0d930-f7db-4afc-a15a-27c9ce13ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Volume volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 (3b0ea1e3-ead0-4028-8055-08ba07f14948): created successfully Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f0d930-f7db-4afc-a15a-27c9ce13ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Flow 'volume_create_manager' (a73c2169-aeac-45bb-872e-919709d0ab33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-123f6b9e-2327-47e5-820c-94801ea8768a tempest-AttachVolumeShelveTestJSON-1488616771 None] Created volume successfully. Sep 28 05:04:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8c9e8280-5fbf-4cf1-92a3-14464e8b31a6 tempest-GroupSnapshotsV319Test-562559842 None] Group tempest-GroupSnapshotsV319Test-Group-225871109: creating Sep 28 05:04:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8c9e8280-5fbf-4cf1-92a3-14464e8b31a6 tempest-GroupSnapshotsV319Test-562559842 None] Group tempest-GroupSnapshotsV319Test-Group-225871109: created successfully Sep 28 05:04:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8c9e8280-5fbf-4cf1-92a3-14464e8b31a6 tempest-GroupSnapshotsV319Test-562559842 None] Create group completed successfully. Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Flow 'volume_create_manager' (a29321ef-39ee-4937-b506-43adfb969a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033ef9d7-22a1-42b0-987f-abcbbcbbbe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033ef9d7-22a1-42b0-987f-abcbbcbbbe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664178831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=307b1694-9466-4aa4-a389-fa5faae4cd1f,host='devstack@QuobyteHD#QuobyteHD',id=b91e5222-b583-4124-aee0-007ebf482d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb71fbb3ce8b4407865d0a8ea46a2edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:46Z,use_quota=True,user_id='10cea5ad04074c519db77d2ac37645ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14b5b34b-ffd8-4b6d-9056-1b29e3418cd1),volume_type_id=14b5b34b-ffd8-4b6d-9056-1b29e3418cd1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766e7015-7671-4977-97bc-caeee66afa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766e7015-7671-4977-97bc-caeee66afa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cd9246-d56b-48b1-b809-9d6c41da7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cd9246-d56b-48b1-b809-9d6c41da7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b91e5222-b583-4124-aee0-007ebf482d9c', 'volume_name': 'volume-b91e5222-b583-4124-aee0-007ebf482d9c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8e6dc-6b39-4d6d-a324-445c3cad0639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8e6dc-6b39-4d6d-a324-445c3cad0639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d6255f-ef84-42aa-88ce-0e4e45e3674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:46 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Volume b91e5222-b583-4124-aee0-007ebf482d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b91e5222-b583-4124-aee0-007ebf482d9c', 'volume_size': 1} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=307b1694-9466-4aa4-a389-fa5faae4cd1f,created_at=2026-09-28T03:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664178831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=307b1694-9466-4aa4-a389-fa5faae4cd1f,host='devstack@QuobyteHD#QuobyteHD',id=b91e5222-b583-4124-aee0-007ebf482d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb71fbb3ce8b4407865d0a8ea46a2edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:04:46Z,use_quota=True,user_id='10cea5ad04074c519db77d2ac37645ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14b5b34b-ffd8-4b6d-9056-1b29e3418cd1),volume_type_id=14b5b34b-ffd8-4b6d-9056-1b29e3418cd1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Creating volume b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:04:46 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:46 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c 1073741824 Sep 28 05:04:46 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:46 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c 1073741824" returned: 0 in 0.631s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:46 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c Sep 28 05:04:46 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:47 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c" returned: 0 in 0.391s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d6255f-ef84-42aa-88ce-0e4e45e3674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b91e5222-b583-4124-aee0-007ebf482d9c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea1506f-c543-4bd1-967b-0706cc85f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:04:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Volume volume-b91e5222-b583-4124-aee0-007ebf482d9c (b91e5222-b583-4124-aee0-007ebf482d9c): created successfully Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea1506f-c543-4bd1-967b-0706cc85f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:04:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Flow 'volume_create_manager' (a29321ef-39ee-4937-b506-43adfb969a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:04:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-222b4d9a-8a77-4103-bb02-839218827903 tempest-GroupSnapshotsV319Test-562559842 None] Created volume successfully. Sep 28 05:04:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] GroupSnapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: creating. Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Group snapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: creating. {{(pid=86815) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Creating offline snapshot 23cddf33-a8dd-4794-a4a6-a46a039353d5 of volume b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[00402776-d407-4ddd-b587-94b2912cf40c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:49 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c Sep 28 05:04:49 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:49 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c" returned: 0 in 0.541s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:49 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 1G Sep 28 05:04:49 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:50 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 1G" returned: 0 in 0.560s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5222-b583-4124-aee0-007ebf482d9c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:50 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5222-b583-4124-aee0-007ebf482d9c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 Sep 28 05:04:50 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:50 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91e5222-b583-4124-aee0-007ebf482d9c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5" returned: 0 in 0.382s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:50 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:50 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 Sep 28 05:04:50 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:50 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5" returned: 0 in 0.282s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:50 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info Sep 28 05:04:50 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:51 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:51 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:04:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:51 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info Sep 28 05:04:51 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:51 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.info" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-132c46e6-2dfc-4663-a7d8-86699d7bcb1d tempest-GroupSnapshotsV319Test-562559842 None] group_snapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: created successfully Sep 28 05:04:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] group_snapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: deleting Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] group_snapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: deleting {{(pid=86815) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "cinder-quobyte-23cddf33-a8dd-4794-a4a6-a46a039353d5" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-23cddf33-a8dd-4794-a4a6-a46a039353d5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Deleting offline snapshot 23cddf33-a8dd-4794-a4a6-a46a039353d5 of volume b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:04:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] snapshot_file for this snap is: volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca01585-f070-4566-82b8-05c7d24a55f2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:53 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 Sep 28 05:04:53 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:53 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5" returned: 0 in 0.851s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b91e5222-b583-4124-aee0-007ebf482d9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[961664d1-785f-4c05-a57d-d4a7cb6c3ee5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:54 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c Sep 28 05:04:54 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:54 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c" returned: 0 in 0.614s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:54 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 Sep 28 05:04:54 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:54 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5" returned: 0 in 0.407s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:54 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5 Sep 28 05:04:54 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:55 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c.23cddf33-a8dd-4794-a4a6-a46a039353d5" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-23cddf33-a8dd-4794-a4a6-a46a039353d5" released by "_delete_snapshot" :: held 2.340s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" released by "delete_snapshot" :: held 2.379s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:55 devstack cinder-volume[86815]: WARNING cinder.quota [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1512270455 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1512270455, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:04:55 devstack cinder-volume[86815]: WARNING cinder.quota [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1512270455 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1512270455, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:04:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] Created reservations ['b3382f38-d699-4313-ab91-b0ed6334830a', '1109d448-e53c-4cb6-a618-554164146250', 'ae66df43-99c7-4796-8e44-1227c2bc7bff', 'f159868a-2cee-4e51-acc6-b702c19ea983'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-51dd33cb-6cc2-4c56-bc63-c0a5f52177f9 tempest-GroupSnapshotsV319Test-562559842 None] group_snapshot 9adb7268-ba1c-4d8e-abe0-99b1c1551182: deleted successfully Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e6ea1c-f20f-4b94-9ff9-f7518508c8c1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:56 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c Sep 28 05:04:56 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:56 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c" returned: 0 in 0.478s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:56 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c Sep 28 05:04:56 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:56 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b91e5222-b583-4124-aee0-007ebf482d9c" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Lock "cinder-quobyte-b91e5222-b583-4124-aee0-007ebf482d9c" released by "delete_volume" :: held 0.881s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Created reservations ['a705a47d-1f57-4d3a-bdb6-0e3f21d76401'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:57 devstack cinder-volume[86815]: WARNING cinder.quota [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1512270455 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1512270455, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Created reservations ['20ed7a1d-b79c-4e48-a80c-7ee97eb25031', '723371f4-0840-49f9-9c63-e53d33593435', '851ac379-5896-4014-a53e-3f56a4edaf39', '064dfde9-de26-488f-9dc5-0b30d9b948fe'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:04:57 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:04:57 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:04:57 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:04:57 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:04:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6743548b-bb30-4a66-b0eb-353371195ed4 tempest-GroupSnapshotsV319Test-562559842 None] Delete group completed successfully. Sep 28 05:04:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-298b58b7-be98-4d18-9901-8546ac4a5b55 req-a5cbac80-1ff4-4e4d-aacd-7bff14233baf tempest-AttachVolumeShelveTestJSON-1488616771 None] No connector for attachment d2286353-c97f-431d-9c4e-eab99c534fbb; skipping storage backend terminate_connection call. {{(pid=86815) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 05:04:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-298b58b7-be98-4d18-9901-8546ac4a5b55 req-a5cbac80-1ff4-4e4d-aacd-7bff14233baf tempest-AttachVolumeShelveTestJSON-1488616771 None] Deleting attachment d2286353-c97f-431d-9c4e-eab99c534fbb. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:05:09 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=59,cinder:SELECT=56,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:05:09 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=57,cinder:UPDATE=63,cinder:DELETE=1,cinder:INSERT=14 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Flow 'volume_create_manager' (9434bd30-f5db-4b95-ac10-f07db3bc2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7492cf8a-84c2-4bc6-9499-f82fcfadeb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7492cf8a-84c2-4bc6-9499-f82fcfadeb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-720092466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32acc66b-e6ab-47d2-a211-4e05f8d9ee5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b489a200a8c46fb8122c37de04536b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:14Z,use_quota=True,user_id='9db7063528644d94b416d20c605d5291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc42994-bd33-48eb-a30b-7870c100ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc42994-bd33-48eb-a30b-7870c100ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfee7d0-d670-43ca-bccb-efbab405a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfee7d0-d670-43ca-bccb-efbab405a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32acc66b-e6ab-47d2-a211-4e05f8d9ee5e', 'volume_name': 'volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c6a00e-2fb4-4d9b-b5d9-31c22b67d33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c6a00e-2fb4-4d9b-b5d9-31c22b67d33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c3d48-0420-4fdb-88b0-30f94f850599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Volume 32acc66b-e6ab-47d2-a211-4e05f8d9ee5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e', 'volume_size': 1} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-720092466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32acc66b-e6ab-47d2-a211-4e05f8d9ee5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b489a200a8c46fb8122c37de04536b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:14Z,use_quota=True,user_id='9db7063528644d94b416d20c605d5291',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Creating volume 32acc66b-e6ab-47d2-a211-4e05f8d9ee5e {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:05:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:05:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:14 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e 1073741824 Sep 28 05:05:14 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:14 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e 1073741824" returned: 0 in 0.924s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:15 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e Sep 28 05:05:15 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:15 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" returned: 0 in 0.451s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c3d48-0420-4fdb-88b0-30f94f850599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83609d81-76ad-47c8-b55a-2a2e53559e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Volume volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e (32acc66b-e6ab-47d2-a211-4e05f8d9ee5e): created successfully Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83609d81-76ad-47c8-b55a-2a2e53559e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Flow 'volume_create_manager' (9434bd30-f5db-4b95-ac10-f07db3bc2de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8db1d87d-60bf-4801-be1b-57f9bc5f6d93 tempest-TaggedAttachmentsTest-586002185 None] Created volume successfully. Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Flow 'volume_create_manager' (8eeea5fd-18ed-473a-a792-38e732e092d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1652b1a2-e5f7-43d2-b688-a2294d49e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1652b1a2-e5f7-43d2-b688-a2294d49e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1404574453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2434e1-7590-4abe-9be2-12f0451ae451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895ae47b49f40f4941dc065008c743a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:22Z,use_quota=True,user_id='da7c9f87bc9f4739b8f2fbeecc2b2aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be37b89e-14a2-42c0-ad74-adfd7f7802ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be37b89e-14a2-42c0-ad74-adfd7f7802ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b42d35-a2b9-464f-898a-77d5c93f2968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b42d35-a2b9-464f-898a-77d5c93f2968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2434e1-7590-4abe-9be2-12f0451ae451', 'volume_name': 'volume-0d2434e1-7590-4abe-9be2-12f0451ae451', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa07d39-d3ae-4c01-a8c0-c79dd094942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa07d39-d3ae-4c01-a8c0-c79dd094942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a222284-6582-4505-b7c3-42af36e0c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Volume 0d2434e1-7590-4abe-9be2-12f0451ae451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2434e1-7590-4abe-9be2-12f0451ae451', 'volume_size': 1} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1404574453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2434e1-7590-4abe-9be2-12f0451ae451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895ae47b49f40f4941dc065008c743a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:22Z,use_quota=True,user_id='da7c9f87bc9f4739b8f2fbeecc2b2aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Creating volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:05:21 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:05:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:21 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 1073741824 Sep 28 05:05:21 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:22 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 1073741824" returned: 0 in 0.776s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:22 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 Sep 28 05:05:22 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:23 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451" returned: 0 in 0.432s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a222284-6582-4505-b7c3-42af36e0c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2434e1-7590-4abe-9be2-12f0451ae451', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ebddb3-746a-466b-ab87-edd2ac325a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Volume volume-0d2434e1-7590-4abe-9be2-12f0451ae451 (0d2434e1-7590-4abe-9be2-12f0451ae451): created successfully Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ebddb3-746a-466b-ab87-edd2ac325a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Flow 'volume_create_manager' (8eeea5fd-18ed-473a-a792-38e732e092d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e9372c29-8f3a-433b-9cf6-a19a165b7e8e tempest-SnapshotsActionsTest-820760099 None] Created volume successfully. Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Creating offline snapshot fca0308f-9e39-448b-9c4b-fd27285d1e25 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc40e1-4318-405d-9596-351fecd44766]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:24 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 Sep 28 05:05:24 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:24 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451" returned: 0 in 0.512s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:24 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 1G Sep 28 05:05:24 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:25 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 1G" returned: 0 in 0.748s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:25 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:25 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:26 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.517s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:26 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 is being set with open permissions: ugo+rw Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:26 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:26 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:26 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.418s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:26 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info Sep 28 05:05:26 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:26 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:26 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info is being set with open permissions: ugo+rw Sep 28 05:05:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:26 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info Sep 28 05:05:26 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:27 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.info" returned: 0 in 0.323s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e69ac4b7-9fda-4cc2-bf5b-b6e49f28fd98 tempest-SnapshotsActionsTest-820760099 None] Create snapshot completed successfully Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Creating offline snapshot 7543744b-b5ce-4c9b-a078-035c7e7cf877 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff030bbc-3ac6-4604-a5ad-9752fa7116e2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:28 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:28 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:28 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.757s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:28 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 1G Sep 28 05:05:28 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:29 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:05:29 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:29 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.469s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:05:29 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 1G" returned: 0 in 1.036s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:30 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 Sep 28 05:05:30 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:30 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:30 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 is being set with open permissions: ugo+rw Sep 28 05:05:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:30 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 Sep 28 05:05:30 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:30 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5ca39cfc-90ef-4a75-bb5b-c63abd1a614e tempest-SnapshotsActionsTest-820760099 None] Create snapshot completed successfully Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-7543744b-b5ce-4c9b-a078-035c7e7cf877-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-7543744b-b5ce-4c9b-a078-035c7e7cf877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-7543744b-b5ce-4c9b-a078-035c7e7cf877" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-7543744b-b5ce-4c9b-a078-035c7e7cf877" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Deleting offline snapshot 7543744b-b5ce-4c9b-a078-035c7e7cf877 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] snapshot_file for this snap is: volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8103d9-df0d-4037-95fb-217d5b499d46]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:31 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 Sep 28 05:05:31 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:32 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877" returned: 0 in 0.448s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a9c14c-6306-41eb-96b4-095698965bd6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:32 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:32 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:32 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.506s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:32 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 Sep 28 05:05:32 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:33 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877" returned: 0 in 0.762s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:33 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877 Sep 28 05:05:33 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:34 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7543744b-b5ce-4c9b-a078-035c7e7cf877" returned: 0 in 0.508s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-7543744b-b5ce-4c9b-a078-035c7e7cf877" released by "_delete_snapshot" :: held 2.419s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_snapshot" :: held 2.464s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:34 devstack cinder-volume[86815]: WARNING cinder.quota [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:05:34 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Created reservations ['6993a04c-89fc-4dd7-8a26-44960076a8d1', '55a2ba17-4005-4e7d-9846-1651a6150121', '9a66b148-40d3-4a71-8913-5c8ec632aceb', '7ba90558-b870-4d03-b7ce-1d4eb77879ca'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Delete snapshot completed successfully. Sep 28 05:05:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3aff1c3c-6634-4f3b-914b-c8b76031bcc2 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-7543744b-b5ce-4c9b-a078-035c7e7cf877-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Creating offline snapshot 389450f6-548e-4cab-ae7c-ce6334769090 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:05:35 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d909d2-6317-4ce1-971a-b38fad9b25fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:35 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:35 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:36 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.435s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:36 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 1G Sep 28 05:05:36 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:36 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 1G" returned: 0 in 0.459s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:36 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 Sep 28 05:05:36 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:36 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:36 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 is being set with open permissions: ugo+rw Sep 28 05:05:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:36 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 Sep 28 05:05:36 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:37 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.604s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c9963021-1722-43fe-9456-12838bde3f22 tempest-SnapshotsActionsTest-820760099 None] Create snapshot completed successfully Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-389450f6-548e-4cab-ae7c-ce6334769090-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-389450f6-548e-4cab-ae7c-ce6334769090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-389450f6-548e-4cab-ae7c-ce6334769090" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-389450f6-548e-4cab-ae7c-ce6334769090" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Deleting offline snapshot 389450f6-548e-4cab-ae7c-ce6334769090 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] snapshot_file for this snap is: volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6aedba-1830-47e5-83c5-3999f045468a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:37 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 Sep 28 05:05:37 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Flow 'volume_create_manager' (a5a2bfcd-6671-4281-90b8-6fa43fdb3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce9dcb0-24a9-4552-8707-7fd327249358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:38 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce9dcb0-24a9-4552-8707-7fd327249358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1233528749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dd5584d099414cb2b30b11654275fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:38Z,use_quota=True,user_id='51ee5c710e994c49b7a1b6255f876d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaed1db-bdaa-48da-93d2-d5be7b40bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaed1db-bdaa-48da-93d2-d5be7b40bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f30da78-4f68-4992-b35d-7f95b503b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f30da78-4f68-4992-b35d-7f95b503b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'volume_name': 'volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65727948-f988-4cfa-8903-123ef1425ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65727948-f988-4cfa-8903-123ef1425ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250975a3-5f16-4486-b4c1-6e7e69f6609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Volume ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'volume_size': 1} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1233528749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dd5584d099414cb2b30b11654275fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:05:38Z,use_quota=True,user_id='51ee5c710e994c49b7a1b6255f876d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Creating volume ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:05:38 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090" returned: 0 in 0.539s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:38 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 1073741824 Sep 28 05:05:38 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659e2d3-3d0f-46ac-9d3c-325f6ba44b91]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:38 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:38 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:38 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:39 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 1073741824" returned: 0 in 0.615s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:39 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 Sep 28 05:05:39 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:39 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 Sep 28 05:05:39 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:39 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250975a3-5f16-4486-b4c1-6e7e69f6609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe53d8-be71-4ae4-a41a-d2e66edc956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:05:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Volume volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 (ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5): created successfully Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe53d8-be71-4ae4-a41a-d2e66edc956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Flow 'volume_create_manager' (a5a2bfcd-6671-4281-90b8-6fa43fdb3e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:05:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3fa8675e-6a33-4a9d-8989-2080c202941a tempest-ServerActionsTestOtherA-2048631468 None] Created volume successfully. Sep 28 05:05:39 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090" returned: 0 in 0.515s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:39 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090 Sep 28 05:05:39 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:39 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.389450f6-548e-4cab-ae7c-ce6334769090" returned: 0 in 0.286s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-389450f6-548e-4cab-ae7c-ce6334769090" released by "_delete_snapshot" :: held 2.032s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_snapshot" :: held 2.059s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:39 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Created reservations ['2d6d01f6-263a-4f3b-a067-963dfc965ec6', '2450192e-5f10-4eae-b248-db0a57164509', 'a1501048-1700-4f07-9a80-5f57edd2ba86', '8556453e-77fd-4497-b1cc-51a61fe60f74'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Delete snapshot completed successfully. Sep 28 05:05:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcdd377b-f21c-4786-8980-8c3f2c127c2f tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-389450f6-548e-4cab-ae7c-ce6334769090-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Creating offline snapshot 97f13833-48b1-4a2b-8ab3-9046e218eea8 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8832750f-09d9-4530-addc-4154cb88c1e3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:41 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:41 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:41 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.452s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:41 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 1G Sep 28 05:05:41 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:42 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 1G" returned: 0 in 0.628s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:42 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 Sep 28 05:05:42 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:43 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8" returned: 0 in 0.638s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:43 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 is being set with open permissions: ugo+rw Sep 28 05:05:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:43 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 Sep 28 05:05:43 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:43 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8" returned: 0 in 0.389s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a2ee2abb-68e1-483a-aa42-10307fedc4e7 tempest-SnapshotsActionsTest-820760099 None] Create snapshot completed successfully Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-97f13833-48b1-4a2b-8ab3-9046e218eea8-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-97f13833-48b1-4a2b-8ab3-9046e218eea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-97f13833-48b1-4a2b-8ab3-9046e218eea8" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-97f13833-48b1-4a2b-8ab3-9046e218eea8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Deleting offline snapshot 97f13833-48b1-4a2b-8ab3-9046e218eea8 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] snapshot_file for this snap is: volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c03834e-71c4-43b6-8973-c9cb2764d8ec]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:45 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 Sep 28 05:05:45 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:45 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8" returned: 0 in 0.530s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3ec04-34ce-4fcd-bed1-30e792f29f0b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:45 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:45 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:45 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.457s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:46 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 Sep 28 05:05:46 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:46 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8" returned: 0 in 0.554s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:46 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8 Sep 28 05:05:46 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.97f13833-48b1-4a2b-8ab3-9046e218eea8" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:46 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-97f13833-48b1-4a2b-8ab3-9046e218eea8" released by "_delete_snapshot" :: held 2.095s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_snapshot" :: held 2.155s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:47 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Created reservations ['c70def4c-3d94-48d5-a4f3-9b95066b5e81', 'd9739539-e1a0-49e7-86eb-51fcf7566cdf', 'd0308727-8511-45b1-ae21-4ffaf95b0eb7', 'c5962b46-2517-48b5-80c4-14ff8e4b18fa'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Delete snapshot completed successfully. Sep 28 05:05:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0057e5bd-437d-4074-911a-d087e3191342 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-97f13833-48b1-4a2b-8ab3-9046e218eea8-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Creating offline snapshot 7b075238-7d5c-4425-9c30-1648d519c429 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:05:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a923f-7074-4d82-afd9-00e4ec8be677]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:48 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:48 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:49 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.417s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:49 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 1G Sep 28 05:05:49 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:49 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 1G" returned: 0 in 0.553s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:49 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 Sep 28 05:05:49 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:50 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:50 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 is being set with open permissions: ugo+rw Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:50 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 Sep 28 05:05:50 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:50 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c68b6d4e-8aa0-4983-b350-b85be3612c49 tempest-SnapshotsActionsTest-820760099 None] Create snapshot completed successfully Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-7b075238-7d5c-4425-9c30-1648d519c429-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-7b075238-7d5c-4425-9c30-1648d519c429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Acquiring lock "cinder-quobyte-7b075238-7d5c-4425-9c30-1648d519c429" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-7b075238-7d5c-4425-9c30-1648d519c429" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Deleting offline snapshot 7b075238-7d5c-4425-9c30-1648d519c429 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] snapshot_file for this snap is: volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300f892-fda7-4ff9-8ced-97a9ae791bcd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:51 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 Sep 28 05:05:51 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:51 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429" returned: 0 in 0.445s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0532b0-002a-4266-87c5-9efd0c173ea7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:51 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:51 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:51 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.504s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:51 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 Sep 28 05:05:51 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:52 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429" returned: 0 in 0.487s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:52 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429 Sep 28 05:05:52 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:52 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.7b075238-7d5c-4425-9c30-1648d519c429" returned: 0 in 0.279s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-7b075238-7d5c-4425-9c30-1648d519c429" released by "_delete_snapshot" :: held 1.849s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_snapshot" :: held 1.876s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Created reservations ['6993df57-17f6-4d2a-af2e-b3c42b73c989', '1c72bd93-e027-472a-87e4-7c313dc09002', '3020b86d-ff5f-4386-8604-9f4c1ae57cd4', '12cf29ca-af24-4e69-9ae0-b690b4e5e1e8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Delete snapshot completed successfully. Sep 28 05:05:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2fa3430f-0af6-4797-a929-a9947f1abfa0 tempest-SnapshotsActionsTest-578427541 None] Lock "cinder-7b075238-7d5c-4425-9c30-1648d519c429-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "cinder-fca0308f-9e39-448b-9c4b-fd27285d1e25-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-fca0308f-9e39-448b-9c4b-fd27285d1e25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "cinder-quobyte-fca0308f-9e39-448b-9c4b-fd27285d1e25" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-fca0308f-9e39-448b-9c4b-fd27285d1e25" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Deleting offline snapshot fca0308f-9e39-448b-9c4b-fd27285d1e25 of volume 0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] snapshot_file for this snap is: volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ab59b-cd01-43b4-a5a5-ce98ed5f1a51]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:53 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:53 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:53 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d2434e1-7590-4abe-9be2-12f0451ae451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ac8cc-0922-4f2d-bd0a-1a9f34c8706b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:54 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 Sep 28 05:05:54 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:54 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451" returned: 0 in 0.395s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:54 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:54 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:54 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.334s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:54 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25 Sep 28 05:05:54 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:54 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451.fca0308f-9e39-448b-9c4b-fd27285d1e25" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-fca0308f-9e39-448b-9c4b-fd27285d1e25" released by "_delete_snapshot" :: held 1.467s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_snapshot" :: held 1.492s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Created reservations ['53ad01eb-f355-459c-ab36-a2b6be5ce849', 'ce0e046c-5153-48cd-b615-29c3c09a88f0', '267b52c0-a261-4a60-86c5-f1daab601399', 'b94668ac-5687-4504-ae97-50e43dbaf538'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Delete snapshot completed successfully. Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-04fe4e9c-4960-4f64-ae4f-b1daf0a1a245 tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-fca0308f-9e39-448b-9c4b-fd27285d1e25-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "cinder-0d2434e1-7590-4abe-9be2-12f0451ae451-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-0d2434e1-7590-4abe-9be2-12f0451ae451-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04443b0-eaff-49ae-8ba2-f013d073376a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:05:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:55 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 Sep 28 05:05:55 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:56 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451" returned: 0 in 0.379s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:56 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451 Sep 28 05:05:56 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:56 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0d2434e1-7590-4abe-9be2-12f0451ae451" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-quobyte-0d2434e1-7590-4abe-9be2-12f0451ae451" released by "delete_volume" :: held 0.745s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Created reservations ['d160f927-214c-4fbd-a5d4-7063b687563e', 'bb5ddd79-7baa-4be8-9bb2-880b35759ccb', 'b99beb7b-c842-4f6e-9b6f-2d9613e1b665', 'aa83326d-39b8-4f75-9e8b-7a7a3df1ea23'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:05:56 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:05:56 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:05:56 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:05:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Deleted volume successfully. Sep 28 05:05:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cf77e348-49b3-45d9-b0db-1da90f9b5e6a tempest-SnapshotsActionsTest-820760099 None] Lock "cinder-0d2434e1-7590-4abe-9be2-12f0451ae451-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Acquiring lock "cinder-3b0ea1e3-ead0-4028-8055-08ba07f14948-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "cinder-3b0ea1e3-ead0-4028-8055-08ba07f14948-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Acquiring lock "cinder-quobyte-3b0ea1e3-ead0-4028-8055-08ba07f14948" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "cinder-quobyte-3b0ea1e3-ead0-4028-8055-08ba07f14948" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68e4881-486a-47f6-853b-09f0b9f62e0d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:03 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 Sep 28 05:06:03 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:03 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948" returned: 0 in 0.427s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:03 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948 Sep 28 05:06:03 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:03 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b0ea1e3-ead0-4028-8055-08ba07f14948" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "cinder-quobyte-3b0ea1e3-ead0-4028-8055-08ba07f14948" released by "delete_volume" :: held 0.744s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Created reservations ['5f34805c-243b-49a2-91f7-5623cf22f867', 'ad3ef891-f6f4-4b66-9b03-16e728f7b199', '2ff17237-f8e4-40c9-b56c-b6082a46bf1d', '1c00c67d-58c7-418a-af6c-86d34c6bf462'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:04 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:06:04 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:04 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:06:04 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Deleted volume successfully. Sep 28 05:06:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1680158e-db50-42aa-8973-b2a8dacb9798 tempest-AttachVolumeShelveTestJSON-1488616771 None] Lock "cinder-3b0ea1e3-ead0-4028-8055-08ba07f14948-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:06:14 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=55,cinder:SELECT=51,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:14 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=55,cinder:INSERT=16,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-7064a6f7-01cf-4057-9114-73c0461be842 req-85d80058-2ef6-4860-bb8c-c0e5a46e91f8 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-7064a6f7-01cf-4057-9114-73c0461be842 req-85d80058-2ef6-4860-bb8c-c0e5a46e91f8 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-7064a6f7-01cf-4057-9114-73c0461be842 req-85d80058-2ef6-4860-bb8c-c0e5a46e91f8 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-7064a6f7-01cf-4057-9114-73c0461be842 req-85d80058-2ef6-4860-bb8c-c0e5a46e91f8 tempest-ServerActionsTestOtherA-2048631468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35a0607e-7493-4c5c-9151-34f3d6b75c2a', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:06:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-7064a6f7-01cf-4057-9114-73c0461be842 req-85d80058-2ef6-4860-bb8c-c0e5a46e91f8 tempest-ServerActionsTestOtherA-2048631468 None] attachment_update completed successfully. Sep 28 05:06:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ed93368e-a645-4a2b-80e7-e085353a9f0c req-4f73b840-3f15-454e-98dd-da88bd47e3c5 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ed93368e-a645-4a2b-80e7-e085353a9f0c req-4f73b840-3f15-454e-98dd-da88bd47e3c5 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ed93368e-a645-4a2b-80e7-e085353a9f0c req-4f73b840-3f15-454e-98dd-da88bd47e3c5 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-ed93368e-a645-4a2b-80e7-e085353a9f0c req-4f73b840-3f15-454e-98dd-da88bd47e3c5 tempest-TaggedAttachmentsTest-586002185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03e14b89-1fc2-4025-ad61-56eaffb027ed', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:06:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-ed93368e-a645-4a2b-80e7-e085353a9f0c req-4f73b840-3f15-454e-98dd-da88bd47e3c5 tempest-TaggedAttachmentsTest-586002185 None] attachment_update completed successfully. Sep 28 05:06:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-fc113fb2-bd7f-49c7-a6fe-a078cf034df6 tempest-ServerActionsTestOtherA-2048631468 None] Terminate volume connection completed successfully. Sep 28 05:06:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-fc113fb2-bd7f-49c7-a6fe-a078cf034df6 tempest-ServerActionsTestOtherA-2048631468 None] Deleting attachment 35a0607e-7493-4c5c-9151-34f3d6b75c2a. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:06:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-76b689d1-3c6d-4647-9bbf-68adcccd015e req-099585c9-7e50-4650-bfd3-c3faf03d7f38 tempest-TaggedAttachmentsTest-586002185 None] Terminate volume connection completed successfully. Sep 28 05:06:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-76b689d1-3c6d-4647-9bbf-68adcccd015e req-099585c9-7e50-4650-bfd3-c3faf03d7f38 tempest-TaggedAttachmentsTest-586002185 None] Deleting attachment 03e14b89-1fc2-4025-ad61-56eaffb027ed. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:06:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-81b74fb3-3393-45b2-b5e6-ad3772669040 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-81b74fb3-3393-45b2-b5e6-ad3772669040 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-81b74fb3-3393-45b2-b5e6-ad3772669040 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-81b74fb3-3393-45b2-b5e6-ad3772669040 tempest-ServerActionsTestOtherA-2048631468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e70dfca-54ad-4c54-b9b8-4214f5ee6d35', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:06:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-d193c812-7b4d-4e29-9149-5c697bb82f2a req-81b74fb3-3393-45b2-b5e6-ad3772669040 tempest-ServerActionsTestOtherA-2048631468 None] attachment_update completed successfully. Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:29 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:06:29 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:29 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.501s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 8 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:06:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:06:33 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:33 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=28,cinder:UPDATE=3 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "cinder-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "cinder-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "cinder-quobyte-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "cinder-quobyte-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee548e43-aeab-4a0a-9c2e-22631ff0fce9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:40 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e Sep 28 05:06:40 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:40 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" returned: 0 in 0.752s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:41 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e Sep 28 05:06:41 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:41 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" returned: 0 in 0.523s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "cinder-quobyte-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e" released by "delete_volume" :: held 1.398s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Created reservations ['c1c4bca5-2ba0-45c8-98a0-aff7a893942d', 'bd318351-d99f-4a1c-8c3c-8280d3da5b2e', '0a820388-4b8c-441b-b6f9-e6e8c0a24d3b', '624e79c6-1c15-41ac-8a12-dcb27d2aacdb'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:06:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:06:41 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:06:41 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:06:42 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Sep 28 05:06:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:06:42 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:06:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Deleted volume successfully. Sep 28 05:06:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-42149b59-979a-4895-983c-1edfc97b9de1 tempest-TaggedAttachmentsTest-586002185 None] Lock "cinder-32acc66b-e6ab-47d2-a211-4e05f8d9ee5e-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:06:54 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:54 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:06:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-8b0d6c0f-da55-4712-89b4-0d2c49d4f271 req-6a375414-fd3c-4250-942a-c073a3fc4c1b tempest-ServerActionsTestOtherA-2048631468 None] Terminate volume connection completed successfully. Sep 28 05:06:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-8b0d6c0f-da55-4712-89b4-0d2c49d4f271 req-6a375414-fd3c-4250-942a-c073a3fc4c1b tempest-ServerActionsTestOtherA-2048631468 None] Deleting attachment 4e70dfca-54ad-4c54-b9b8-4214f5ee6d35. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:07:05 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Flow 'volume_create_manager' (77cc1854-af49-460c-9325-ad3422b4c5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e7e0ce-064c-4d70-9d12-783ea1ff2c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e7e0ce-064c-4d70-9d12-783ea1ff2c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1397690467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf81a17-8203-48fb-9cd3-cb737a49823f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dd5584d099414cb2b30b11654275fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:08Z,use_quota=True,user_id='51ee5c710e994c49b7a1b6255f876d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81226eac-6705-409e-9068-a00473884988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81226eac-6705-409e-9068-a00473884988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf37d538-bacb-453d-a240-20636bb36ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:07 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:07:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf37d538-bacb-453d-a240-20636bb36ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fbf81a17-8203-48fb-9cd3-cb737a49823f', 'volume_name': 'volume-fbf81a17-8203-48fb-9cd3-cb737a49823f', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e48bbc-30e6-4a0a-8d3a-1c91b9d42c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e48bbc-30e6-4a0a-8d3a-1c91b9d42c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15bc702-ebb7-4185-a310-f42862bc5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Volume fbf81a17-8203-48fb-9cd3-cb737a49823f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fbf81a17-8203-48fb-9cd3-cb737a49823f', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 05:07:08 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Trying to clone fbf81a17-8203-48fb-9cd3-cb737a49823f from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:07:09 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Image download 20.69 MB at 20.69 MB/s Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0f1a4-92b0-4271-9f3e-c1370fb3c919]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:09 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD Sep 28 05:07:09 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:09 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b is fetched for user 51ee5c710e994c49b7a1b6255f876d19. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdf89a-f12b-4bb4-86a1-582b1c9585c0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:09 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD Sep 28 05:07:09 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:10 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1397690467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf81a17-8203-48fb-9cd3-cb737a49823f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dd5584d099414cb2b30b11654275fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:08Z,use_quota=True,user_id='51ee5c710e994c49b7a1b6255f876d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Creating volume fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:10 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:10 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1073741824 Sep 28 05:07:10 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:10 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1073741824" returned: 0 in 0.543s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:10 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f Sep 28 05:07:10 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:10 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:11 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Attempting download of 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume fbf81a17-8203-48fb-9cd3-cb737a49823f. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:07:11 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6784a14-477d-4d20-8163-a09dfdbf42e4]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:11 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd Sep 28 05:07:11 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:11 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd" returned: 0 in 0.542s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:11 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd Sep 28 05:07:11 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:12 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd" returned: 1 in 0.863s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_ffi8ujfd' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:07:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71c6f5-9fce-44fc-9cb4-f58c50a8bf3e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:12 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD Sep 28 05:07:12 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:13 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:13 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] 1cf8d7db-9851-461c-94d0-a979c9e2e98b was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:07:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:13 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f Sep 28 05:07:13 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:16 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f" returned: 0 in 3.279s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:16 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_wke1zfrldevstack@QuobyteHD, size 112.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:07:16 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Converted 112.00 MB image at 34.13 MB/s Sep 28 05:07:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:16 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1G Sep 28 05:07:16 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:17 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f 1G" returned: 0 in 0.756s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Downloaded image 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume fbf81a17-8203-48fb-9cd3-cb737a49823f successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b for user 51ee5c710e994c49b7a1b6255f876d19 is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Marking volume fbf81a17-8203-48fb-9cd3-cb737a49823f as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Copying metadata from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b to fbf81a17-8203-48fb-9cd3-cb737a49823f. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Creating volume glance metadata for volume fbf81a17-8203-48fb-9cd3-cb737a49823f backed by image 1cf8d7db-9851-461c-94d0-a979c9e2e98b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15bc702-ebb7-4185-a310-f42862bc5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf81a17-8203-48fb-9cd3-cb737a49823f', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278e6494-7b3a-4878-aa5d-f17aa1406e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Volume volume-fbf81a17-8203-48fb-9cd3-cb737a49823f (fbf81a17-8203-48fb-9cd3-cb737a49823f): created successfully Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278e6494-7b3a-4878-aa5d-f17aa1406e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Flow 'volume_create_manager' (77cc1854-af49-460c-9325-ad3422b4c5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-596dcf21-13db-4193-9f2b-b7bd6eb78d27 tempest-ServerActionsTestOtherA-2048631468 None] Created volume successfully. Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (0e21a6b5-e6ed-4a2f-a9de-a9d3759039c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c24d5-91c4-4e45-86b5-ef159fa1ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101c24d5-91c4-4e45-86b5-ef159fa1ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-993363526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0293b459-57c2-4882-9926-c3600941c2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:17Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d345497-3ddf-4690-a7f8-04511d380962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d345497-3ddf-4690-a7f8-04511d380962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11de75c-7f6a-4c42-af39-65a6fad49d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11de75c-7f6a-4c42-af39-65a6fad49d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0293b459-57c2-4882-9926-c3600941c2d3', 'volume_name': 'volume-0293b459-57c2-4882-9926-c3600941c2d3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b352cd33-5ac6-4350-8cd0-c3920b207d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b352cd33-5ac6-4350-8cd0-c3920b207d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062e9937-ee05-4771-9653-a3d565bd9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Volume 0293b459-57c2-4882-9926-c3600941c2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0293b459-57c2-4882-9926-c3600941c2d3', 'volume_size': 1} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-993363526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0293b459-57c2-4882-9926-c3600941c2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:17Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Creating volume 0293b459-57c2-4882-9926-c3600941c2d3 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:17 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:17 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 1073741824 Sep 28 05:07:17 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (8f1068c4-3c18-4309-8864-965cd1321943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b69bd5-7c1e-4a71-8fa1-fc22e9a7f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b69bd5-7c1e-4a71-8fa1-fc22e9a7f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275107627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120e82d1-4a42-49e8-a6b6-a61528781774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:18Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f2e0a4-e3f6-488e-b5ef-20a240044a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f2e0a4-e3f6-488e-b5ef-20a240044a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ae5454-550b-41d5-8602-dfc7e1e8dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ae5454-550b-41d5-8602-dfc7e1e8dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120e82d1-4a42-49e8-a6b6-a61528781774', 'volume_name': 'volume-120e82d1-4a42-49e8-a6b6-a61528781774', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15631612-7327-438b-90ce-4d07dd5c3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15631612-7327-438b-90ce-4d07dd5c3ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f9ee3a-b5c3-487e-97c4-d415469e0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:18 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Volume 120e82d1-4a42-49e8-a6b6-a61528781774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120e82d1-4a42-49e8-a6b6-a61528781774', 'volume_size': 1} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:18 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 1073741824" returned: 0 in 0.783s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:18 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 Sep 28 05:07:18 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:18 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275107627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120e82d1-4a42-49e8-a6b6-a61528781774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:18Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Creating volume 120e82d1-4a42-49e8-a6b6-a61528781774 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:18 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062e9937-ee05-4771-9653-a3d565bd9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0293b459-57c2-4882-9926-c3600941c2d3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:18 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 1073741824 Sep 28 05:07:18 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9f82d-d41d-4eeb-b790-4a4987d9aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Volume volume-0293b459-57c2-4882-9926-c3600941c2d3 (0293b459-57c2-4882-9926-c3600941c2d3): created successfully Sep 28 05:07:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a9f82d-d41d-4eeb-b790-4a4987d9aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (0e21a6b5-e6ed-4a2f-a9de-a9d3759039c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-054ab101-5bfb-41fe-917b-fe75c313888d tempest-AttachVolumeNegativeTest-1992678294 None] Created volume successfully. Sep 28 05:07:19 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 1073741824" returned: 0 in 0.661s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:19 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 Sep 28 05:07:19 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:20 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774" returned: 0 in 0.445s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f9ee3a-b5c3-487e-97c4-d415469e0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120e82d1-4a42-49e8-a6b6-a61528781774', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec3de8f-eb80-42fe-9c66-e6eb7cbd0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Volume volume-120e82d1-4a42-49e8-a6b6-a61528781774 (120e82d1-4a42-49e8-a6b6-a61528781774): created successfully Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec3de8f-eb80-42fe-9c66-e6eb7cbd0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (8f1068c4-3c18-4309-8864-965cd1321943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1edbdf1c-a189-4c8f-9ea2-82dac41259b0 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-778d643f-3c4d-4c06-9128-37e24cab8c37 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774" by "attach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-778d643f-3c4d-4c06-9128-37e24cab8c37 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774" acquired by "attach_volume" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-778d643f-3c4d-4c06-9128-37e24cab8c37 tempest-VolumesActionsTest-555360278 None] Attaching volume 120e82d1-4a42-49e8-a6b6-a61528781774 to instance 92a9a410-a19a-4664-9506-06f1cd8714c8 at mountpoint /dev/vdb on host None. Sep 28 05:07:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-778d643f-3c4d-4c06-9128-37e24cab8c37 tempest-VolumesActionsTest-555360278 None] Attach volume completed successfully. Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-778d643f-3c4d-4c06-9128-37e24cab8c37 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774" released by "attach_volume" :: held 0.238s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-253f8000-f0bf-4f44-9a08-5ea8059c4461 req-2d8caedc-f7d1-4676-bf80-e738793acc89 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-253f8000-f0bf-4f44-9a08-5ea8059c4461 req-2d8caedc-f7d1-4676-bf80-e738793acc89 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-253f8000-f0bf-4f44-9a08-5ea8059c4461 req-2d8caedc-f7d1-4676-bf80-e738793acc89 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-253f8000-f0bf-4f44-9a08-5ea8059c4461 req-2d8caedc-f7d1-4676-bf80-e738793acc89 tempest-AttachVolumeNegativeTest-1992678294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-0293b459-57c2-4882-9926-c3600941c2d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87ce248b-2416-4236-8616-7883b7763d6f', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:07:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-253f8000-f0bf-4f44-9a08-5ea8059c4461 req-2d8caedc-f7d1-4676-bf80-e738793acc89 tempest-AttachVolumeNegativeTest-1992678294 None] attachment_update completed successfully. Sep 28 05:07:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Terminate volume connection completed successfully. Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" by "detach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Detaching volume 120e82d1-4a42-49e8-a6b6-a61528781774 from instance 92a9a410-a19a-4664-9506-06f1cd8714c8. Sep 28 05:07:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Detach volume completed successfully. Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93850578-5ec8-4868-a0bd-4877aa3ac4da tempest-VolumesActionsTest-344519269 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-abd8b166-7f56-413e-8d1c-720a2119e3cc req-89f6a538-6d1d-4af0-bbfe-f4919a5afde4 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-abd8b166-7f56-413e-8d1c-720a2119e3cc req-89f6a538-6d1d-4af0-bbfe-f4919a5afde4 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-abd8b166-7f56-413e-8d1c-720a2119e3cc req-89f6a538-6d1d-4af0-bbfe-f4919a5afde4 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-abd8b166-7f56-413e-8d1c-720a2119e3cc req-89f6a538-6d1d-4af0-bbfe-f4919a5afde4 tempest-ServerActionsTestOtherA-2048631468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-fbf81a17-8203-48fb-9cd3-cb737a49823f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1f96361-6852-4b06-b7c3-6e44ded9920c', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:07:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-abd8b166-7f56-413e-8d1c-720a2119e3cc req-89f6a538-6d1d-4af0-bbfe-f4919a5afde4 tempest-ServerActionsTestOtherA-2048631468 None] attachment_update completed successfully. Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a2d8ec4-0b37-42a9-8cf3-51efb26e6cb7 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" by "detach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a2d8ec4-0b37-42a9-8cf3-51efb26e6cb7 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4a2d8ec4-0b37-42a9-8cf3-51efb26e6cb7 tempest-VolumesActionsTest-555360278 None] Volume detach called, but volume not attached. Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a2d8ec4-0b37-42a9-8cf3-51efb26e6cb7 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-quobyte-120e82d1-4a42-49e8-a6b6-a61528781774" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "cinder-quobyte-120e82d1-4a42-49e8-a6b6-a61528781774" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e7260-b692-4aab-8c0c-beda4243313d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:26 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 Sep 28 05:07:26 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:26 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774" returned: 0 in 0.732s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:26 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774 Sep 28 05:07:26 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:27 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-120e82d1-4a42-49e8-a6b6-a61528781774" returned: 0 in 0.541s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "cinder-quobyte-120e82d1-4a42-49e8-a6b6-a61528781774" released by "delete_volume" :: held 1.408s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Created reservations ['4d30926f-4a6b-4f3a-b235-c3d938696b08', '1ba67c17-ea93-417d-8c29-bb0c99e8adc0', 'e894edbf-c65f-4b60-bd9b-485cc1fcffbc', 'd4e3f3fa-9e2b-4c7b-a6dd-22652ed6a2d0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:27 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:07:27 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:27 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.454s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:07:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Deleted volume successfully. Sep 28 05:07:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1da9848a-32e3-404e-bdd8-ba4e3bb04c76 tempest-VolumesActionsTest-555360278 None] Lock "cinder-120e82d1-4a42-49e8-a6b6-a61528781774-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:29 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:07:29 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:29 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.325s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:07:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (ec0c1527-63d3-46b0-b938-6b4953738acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713c6307-e253-4ee0-b841-875ea0be9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713c6307-e253-4ee0-b841-875ea0be9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512529874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af3d680-7b5f-4039-a785-5ce4ea757ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:35Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00099870-4839-4595-9b0a-ff2ea98e8854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00099870-4839-4595-9b0a-ff2ea98e8854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d8bf49-9a19-4d4f-9a90-6d452c2b8fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d8bf49-9a19-4d4f-9a90-6d452c2b8fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af3d680-7b5f-4039-a785-5ce4ea757ae3', 'volume_name': 'volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6752dd0d-3ee9-48d4-bcba-97cab9518ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6752dd0d-3ee9-48d4-bcba-97cab9518ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e587ef4-153a-4923-81fa-66c48eeb2e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:35 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Volume 6af3d680-7b5f-4039-a785-5ce4ea757ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3', 'volume_size': 1} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512529874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af3d680-7b5f-4039-a785-5ce4ea757ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:35Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Creating volume 6af3d680-7b5f-4039-a785-5ce4ea757ae3 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:35 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:35 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 1073741824 Sep 28 05:07:35 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:36 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 1073741824" returned: 0 in 0.900s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:36 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 Sep 28 05:07:36 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:37 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3" returned: 0 in 0.840s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e587ef4-153a-4923-81fa-66c48eeb2e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0591ecbc-bdd3-46ca-936c-546ce49ace23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Volume volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 (6af3d680-7b5f-4039-a785-5ce4ea757ae3): created successfully Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0591ecbc-bdd3-46ca-936c-546ce49ace23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (ec0c1527-63d3-46b0-b938-6b4953738acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-44706b9f-857b-4124-9043-0e95a41320c4 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-6af3d680-7b5f-4039-a785-5ce4ea757ae3-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "cinder-6af3d680-7b5f-4039-a785-5ce4ea757ae3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-quobyte-6af3d680-7b5f-4039-a785-5ce4ea757ae3" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-6af3d680-7b5f-4039-a785-5ce4ea757ae3" acquired by "delete_volume" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3bc5c-e50f-41ca-87cc-9e60ff440692]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:40 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 Sep 28 05:07:40 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:41 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3" returned: 0 in 1.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:41 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3 Sep 28 05:07:41 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:41 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6af3d680-7b5f-4039-a785-5ce4ea757ae3" returned: 0 in 0.453s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-6af3d680-7b5f-4039-a785-5ce4ea757ae3" released by "delete_volume" :: held 1.856s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Created reservations ['d91438a0-7c80-4b76-9e71-c15bdd68e346', '27e1932f-0803-4ca2-b5ce-0bfe5fd07fdb', '8932d433-e241-48a8-aa49-0354d6b68667', '913508a3-8f76-47e4-9b59-44f5056e44dc'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:42 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:07:42 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:42 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.580s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:42 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:07:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Deleted volume successfully. Sep 28 05:07:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d54cf74-7128-48cf-98f9-30c0ad82fdae tempest-VolumesActionsTest-344519269 None] Lock "cinder-6af3d680-7b5f-4039-a785-5ce4ea757ae3-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (b16c6388-31aa-4b44-abc0-d1acc6506748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e56f051-e115-49d5-a368-e41bcfeea30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e56f051-e115-49d5-a368-e41bcfeea30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629474385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a16adec-67aa-43b6-98f0-a502bd62d6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:44Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c91ab5b-59d7-4c7d-b121-7befcb5ad57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c91ab5b-59d7-4c7d-b121-7befcb5ad57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028c0b7-af05-47a1-b950-e247cdc98e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028c0b7-af05-47a1-b950-e247cdc98e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a16adec-67aa-43b6-98f0-a502bd62d6fe', 'volume_name': 'volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08db822-727b-46ba-9d29-fc0feb43778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08db822-727b-46ba-9d29-fc0feb43778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8273613-32a1-4200-ac73-2cd0c477f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Volume 2a16adec-67aa-43b6-98f0-a502bd62d6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe', 'volume_size': 1} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629474385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a16adec-67aa-43b6-98f0-a502bd62d6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:44Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Creating volume 2a16adec-67aa-43b6-98f0-a502bd62d6fe {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:44 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:44 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe 1073741824 Sep 28 05:07:44 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:45 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe 1073741824" returned: 0 in 0.823s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:45 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe Sep 28 05:07:45 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:46 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe" returned: 0 in 0.978s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8273613-32a1-4200-ac73-2cd0c477f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61e22e7-e9b0-4e21-9ddf-639760dde09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:46 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Volume volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe (2a16adec-67aa-43b6-98f0-a502bd62d6fe): created successfully Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61e22e7-e9b0-4e21-9ddf-639760dde09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (b16c6388-31aa-4b44-abc0-d1acc6506748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-29668c2b-d68a-4355-9150-0e4013c9c5a9 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:07:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-2a16adec-67aa-43b6-98f0-a502bd62d6fe-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "cinder-2a16adec-67aa-43b6-98f0-a502bd62d6fe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-quobyte-2a16adec-67aa-43b6-98f0-a502bd62d6fe" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-2a16adec-67aa-43b6-98f0-a502bd62d6fe" acquired by "delete_volume" :: waited 0.055s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e56e4e-27f1-4204-86ec-41d6dd11c0b7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:48 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe Sep 28 05:07:48 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:49 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe" returned: 0 in 1.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:49 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe Sep 28 05:07:49 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:50 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-2a16adec-67aa-43b6-98f0-a502bd62d6fe" returned: 0 in 1.235s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-2a16adec-67aa-43b6-98f0-a502bd62d6fe" released by "delete_volume" :: held 2.636s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:50 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Created reservations ['b61bf4b0-9c33-41e8-8c77-01738ccddf82', '0fa3341a-c7be-4bb3-917b-e8542f914016', 'efecc5d2-4611-49f2-ab08-706e83eef042', 'df310f85-e3ad-4c7a-879d-a414e78d1c60'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:51 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:07:51 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:52 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 1.048s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:07:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Deleted volume successfully. Sep 28 05:07:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a73a873e-356a-48d3-9a2f-3387cf652235 tempest-VolumesActionsTest-344519269 None] Lock "cinder-2a16adec-67aa-43b6-98f0-a502bd62d6fe-delete_volume" released by "delete_volume" :: held 4.421s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (01b74a82-2b78-4d99-bbca-e60edd44b1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9365fb1-7b13-4a09-95c5-a3ee8fec8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9365fb1-7b13-4a09-95c5-a3ee8fec8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-370581470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e534d78-2835-4a22-8757-d8eb19be2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:53Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450631e2-455e-418a-9b40-9d2af15c7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450631e2-455e-418a-9b40-9d2af15c7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbed8f-acb1-4206-aaaa-74db24a8b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbed8f-acb1-4206-aaaa-74db24a8b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e534d78-2835-4a22-8757-d8eb19be2313', 'volume_name': 'volume-5e534d78-2835-4a22-8757-d8eb19be2313', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7e5287-ea59-46fe-8b60-a1eb4888cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7e5287-ea59-46fe-8b60-a1eb4888cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0589a1f-5ed2-4a32-95ba-39423c4601d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:53 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Volume 5e534d78-2835-4a22-8757-d8eb19be2313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e534d78-2835-4a22-8757-d8eb19be2313', 'volume_size': 1} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-370581470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e534d78-2835-4a22-8757-d8eb19be2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:07:53Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Creating volume 5e534d78-2835-4a22-8757-d8eb19be2313 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:07:53 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:07:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:53 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 1073741824 Sep 28 05:07:53 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:54 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 1073741824" returned: 0 in 1.023s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:54 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 Sep 28 05:07:54 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:55 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313" returned: 0 in 0.619s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0589a1f-5ed2-4a32-95ba-39423c4601d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e534d78-2835-4a22-8757-d8eb19be2313', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddf11a-ff39-48a7-9eab-f055a0b630ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:07:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Volume volume-5e534d78-2835-4a22-8757-d8eb19be2313 (5e534d78-2835-4a22-8757-d8eb19be2313): created successfully Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddf11a-ff39-48a7-9eab-f055a0b630ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (01b74a82-2b78-4d99-bbca-e60edd44b1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:07:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5bdaf7ff-0362-48bb-b9e8-f33883b7b632 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:07:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-5e534d78-2835-4a22-8757-d8eb19be2313-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "cinder-5e534d78-2835-4a22-8757-d8eb19be2313-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-quobyte-5e534d78-2835-4a22-8757-d8eb19be2313" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:07:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-5e534d78-2835-4a22-8757-d8eb19be2313" acquired by "delete_volume" :: waited 0.088s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:07:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaec1a0-56ee-4d6c-be9f-a08fbadf722d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:07:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:56 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 Sep 28 05:07:56 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:58 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313" returned: 0 in 1.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:58 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313 Sep 28 05:07:58 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-af081bf3-e73b-4173-8e28-129d6cee761e tempest-ServerActionsTestOtherA-2048631468 None] Terminate volume connection completed successfully. Sep 28 05:07:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-af081bf3-e73b-4173-8e28-129d6cee761e tempest-ServerActionsTestOtherA-2048631468 None] Deleting attachment a1f96361-6852-4b06-b7c3-6e44ded9920c. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:07:58 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e534d78-2835-4a22-8757-d8eb19be2313" returned: 0 in 0.879s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-5e534d78-2835-4a22-8757-d8eb19be2313" released by "delete_volume" :: held 2.561s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Created reservations ['960abc76-718b-45d5-9521-2e494acddaea', '28502d95-e67e-42e6-aad5-8ab8e8594870', 'a4ff70c4-f8b1-426f-a91d-006d74949f13', '089e1c9f-d56c-4687-b2ca-0d971deabbda'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:07:59 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:07:59 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:07:59 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.490s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:07:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Deleted volume successfully. Sep 28 05:07:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9ffe88eb-c257-4b98-a3fc-72e695a657a0 tempest-VolumesActionsTest-344519269 None] Lock "cinder-5e534d78-2835-4a22-8757-d8eb19be2313-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (30bc454d-7d58-4915-8779-aa1c23f23df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208f0d86-423c-4ccf-a9ca-04e0bd9e1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208f0d86-423c-4ccf-a9ca-04e0bd9e1436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519385188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75dd01-81f5-4bf8-9699-d7c91b941c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:01Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309b0a4-0c39-48af-8ae5-0b7aa0af780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309b0a4-0c39-48af-8ae5-0b7aa0af780e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f092105-5c87-4030-bbb9-7e71945422e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f092105-5c87-4030-bbb9-7e71945422e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa75dd01-81f5-4bf8-9699-d7c91b941c25', 'volume_name': 'volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf37e088-677c-4f14-826d-6196528a1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf37e088-677c-4f14-826d-6196528a1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b40f7e-5a65-4941-8e35-119052352a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:01 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Volume fa75dd01-81f5-4bf8-9699-d7c91b941c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25', 'volume_size': 1} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519385188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75dd01-81f5-4bf8-9699-d7c91b941c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:01Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Creating volume fa75dd01-81f5-4bf8-9699-d7c91b941c25 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:08:01 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:08:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:01 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 1073741824 Sep 28 05:08:01 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 1073741824" returned: 0 in 1.124s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:02 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:02 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 Sep 28 05:08:02 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:02 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25" returned: 0 in 0.574s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:08:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b40f7e-5a65-4941-8e35-119052352a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a78aa7d-5019-4add-b57e-b60f85a4a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Flow 'volume_create_manager' (fbc33c7d-7916-4a0f-90b8-aec58c3d982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0c0dca-9034-4b91-8a44-fdb967bb5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Volume volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 (fa75dd01-81f5-4bf8-9699-d7c91b941c25): created successfully Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a78aa7d-5019-4add-b57e-b60f85a4a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (30bc454d-7d58-4915-8779-aa1c23f23df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0c0dca-9034-4b91-8a44-fdb967bb5f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-449328095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b66afc9626e4943ad3b1276b2c707bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:03Z,use_quota=True,user_id='50560799b3c7466ab7a04bae5065ae0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddac813-f960-46e7-b6cb-80709c49eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddac813-f960-46e7-b6cb-80709c49eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b9354d-ff1d-465b-bcec-39f3c0340798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b9354d-ff1d-465b-bcec-39f3c0340798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce', 'volume_name': 'volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55a7aec-ccea-4e54-8d73-8df087e0f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55a7aec-ccea-4e54-8d73-8df087e0f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181b2e59-2382-469c-908d-9a5e58b6bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Volume 12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce', 'volume_size': 1} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-449328095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b66afc9626e4943ad3b1276b2c707bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:03Z,use_quota=True,user_id='50560799b3c7466ab7a04bae5065ae0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Creating volume 12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:08:03 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-27ab013e-282b-4829-84bc-767834d78505 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:08:03 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce 1073741824 Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-ce3266eb-fa8c-4fc7-8701-c6817fa4d179 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:03 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-fa75dd01-81f5-4bf8-9699-d7c91b941c25-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "cinder-fa75dd01-81f5-4bf8-9699-d7c91b941c25-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Acquiring lock "cinder-quobyte-fa75dd01-81f5-4bf8-9699-d7c91b941c25" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-fa75dd01-81f5-4bf8-9699-d7c91b941c25" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c73c39d-a35f-4a6a-82bf-c705749f9ea0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:03 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 Sep 28 05:08:03 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:03 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce 1073741824" returned: 0 in 0.770s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:04 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce Sep 28 05:08:04 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:04 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25" returned: 0 in 0.654s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:04 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-ce3266eb-fa8c-4fc7-8701-c6817fa4d179 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.142s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:04 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25 Sep 28 05:08:04 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=59,cinder:UPDATE=60,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181b2e59-2382-469c-908d-9a5e58b6bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fbec99-6f8a-4d74-82ed-0932366fdf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-ce3266eb-fa8c-4fc7-8701-c6817fa4d179 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.073s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:04 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Volume volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce (12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce): created successfully Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fbec99-6f8a-4d74-82ed-0932366fdf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Flow 'volume_create_manager' (fbc33c7d-7916-4a0f-90b8-aec58c3d982c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:04 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bde2b3fb-ef33-4736-9dda-d5480478c7c1 tempest-ServerRescueNegativeTestJSON-2055338913 None] Created volume successfully. Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-ce3266eb-fa8c-4fc7-8701-c6817fa4d179 tempest-ServerActionsTestOtherA-2048631468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-fbf81a17-8203-48fb-9cd3-cb737a49823f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43595190-9c69-483b-bd72-518f3a82fe2d', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:08:04 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-6596d3d0-3857-428c-af5e-65fb6f786c9e req-ce3266eb-fa8c-4fc7-8701-c6817fa4d179 tempest-ServerActionsTestOtherA-2048631468 None] attachment_update completed successfully. Sep 28 05:08:04 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa75dd01-81f5-4bf8-9699-d7c91b941c25" returned: 0 in 0.654s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "cinder-quobyte-fa75dd01-81f5-4bf8-9699-d7c91b941c25" released by "delete_volume" :: held 1.383s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Created reservations ['f017666f-45e6-4cb1-a4dd-0341edac251c', '0204202e-ff5d-4796-a59a-0a375bf7e410', '7fd26f7d-91eb-447d-982d-36edf3f7a693', '806dc776-2409-4517-994e-37bdc31791c0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:05 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:08:05 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:06 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 1.236s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:06 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:08:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Deleted volume successfully. Sep 28 05:08:06 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=80,cinder:SELECT=86,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8315d341-6499-4fa5-9c28-50d549637dc3 tempest-VolumesActionsTest-344519269 None] Lock "cinder-fa75dd01-81f5-4bf8-9699-d7c91b941c25-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (c3bd63c5-5897-43a7-96c0-ae81cda88a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd8062-4f5b-4067-bf40-776ad896b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd8062-4f5b-4067-bf40-776ad896b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367179992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3dee81-c0c2-4116-9e54-68bca8638253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:08Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe173c-c103-453c-bcb6-1078f77fa39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe173c-c103-453c-bcb6-1078f77fa39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d914e1b8-fd03-4a3b-bb50-1d45b544e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d914e1b8-fd03-4a3b-bb50-1d45b544e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3dee81-c0c2-4116-9e54-68bca8638253', 'volume_name': 'volume-7f3dee81-c0c2-4116-9e54-68bca8638253', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074e50c-b94a-4f3c-8f0a-7cf3cf292b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074e50c-b94a-4f3c-8f0a-7cf3cf292b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af613d63-ea08-44d6-b8b3-35a63e1476ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Volume 7f3dee81-c0c2-4116-9e54-68bca8638253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3dee81-c0c2-4116-9e54-68bca8638253', 'volume_size': 1} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367179992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3dee81-c0c2-4116-9e54-68bca8638253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aec7771b8e14522a2530580a7911920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:08Z,use_quota=True,user_id='670eadba5fe145199dfa9252d576e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Creating volume 7f3dee81-c0c2-4116-9e54-68bca8638253 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:08:08 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:08:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:08 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 1073741824 Sep 28 05:08:08 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:09 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 1073741824" returned: 0 in 1.159s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:09 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 Sep 28 05:08:09 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:10 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253" returned: 0 in 0.552s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af613d63-ea08-44d6-b8b3-35a63e1476ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3dee81-c0c2-4116-9e54-68bca8638253', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c4f080-966e-420c-92f6-da679c1c3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Volume volume-7f3dee81-c0c2-4116-9e54-68bca8638253 (7f3dee81-c0c2-4116-9e54-68bca8638253): created successfully Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c4f080-966e-420c-92f6-da679c1c3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Flow 'volume_create_manager' (c3bd63c5-5897-43a7-96c0-ae81cda88a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9cb4c770-59d4-46ed-acd8-92f99f41b276 tempest-VolumesActionsTest-555360278 None] Created volume successfully. Sep 28 05:08:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-7f3dee81-c0c2-4116-9e54-68bca8638253-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "cinder-7f3dee81-c0c2-4116-9e54-68bca8638253-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Acquiring lock "cinder-quobyte-7f3dee81-c0c2-4116-9e54-68bca8638253" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "cinder-quobyte-7f3dee81-c0c2-4116-9e54-68bca8638253" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f031c1-e7fb-4dcf-ad94-20bfc4580888]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:08:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:13 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 Sep 28 05:08:13 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:14 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253" returned: 0 in 0.733s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:14 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253 Sep 28 05:08:14 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:14 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f3dee81-c0c2-4116-9e54-68bca8638253" returned: 0 in 0.491s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "cinder-quobyte-7f3dee81-c0c2-4116-9e54-68bca8638253" released by "delete_volume" :: held 1.345s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Created reservations ['e76031c1-1611-4cc7-aad1-1da639d4dab9', '068ca444-2249-43c8-85a3-7c7536dcd03d', 'f599cfa6-7914-4bad-86cd-86afe0358044', '56e38080-b9f7-4d3a-bd35-e19ae59d7bea'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:14 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:08:14 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:15 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.673s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:15 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:08:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Deleted volume successfully. Sep 28 05:08:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3986c564-f546-4f7e-9a92-09bba2c85da6 tempest-VolumesActionsTest-555360278 None] Lock "cinder-7f3dee81-c0c2-4116-9e54-68bca8638253-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Acquiring lock "cinder-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "cinder-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Acquiring lock "cinder-quobyte-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "cinder-quobyte-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[922ffa0d-5ef4-467c-9abe-019052654e20]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:22 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce Sep 28 05:08:22 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:22 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" returned: 0 in 0.548s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:22 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce Sep 28 05:08:22 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:23 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" returned: 0 in 0.479s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "cinder-quobyte-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce" released by "delete_volume" :: held 1.100s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Created reservations ['fdb475b9-a1c7-4cab-8243-6cb9a67d50b6', 'd0c075e3-14f8-461a-812a-0c5bf19a9853', '8363c4e1-3ccd-4b3e-8c88-1877336cc6a4', 'ce27d743-45d7-4d67-a89e-29e9fde11402'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:23 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:08:23 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:23 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:24 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:08:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Deleted volume successfully. Sep 28 05:08:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-19f467d8-6ed2-4640-a823-9a42e4c61136 tempest-ServerRescueNegativeTestJSON-2055338913 None] Lock "cinder-12cb4f39-d02d-4a5c-b60c-49ec6e34e8ce-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:29 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:08:29 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:29 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:08:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:08:33 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=19,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:34 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=18,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Flow 'volume_create_manager' (39af35d5-c7d1-439c-b32a-b8f88c8a2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493c2b34-472f-4d5d-8597-3402dcc94c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493c2b34-472f-4d5d-8597-3402dcc94c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1225794558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac3c6b9-7a6f-4465-bff7-06025305cd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae21433da24d5e8d591a78cddcff83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:41Z,use_quota=True,user_id='6ff7293110c54bc79e55979533603b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d99a6-6ee0-4d16-b077-dfc8ecc5a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d99a6-6ee0-4d16-b077-dfc8ecc5a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aeddac-3db1-4728-b91c-9023fd27c7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aeddac-3db1-4728-b91c-9023fd27c7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac3c6b9-7a6f-4465-bff7-06025305cd27', 'volume_name': 'volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e497d7e6-98b9-40dd-ab81-44205dccfa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e497d7e6-98b9-40dd-ab81-44205dccfa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb28dfd-7c93-4728-86c1-36c9ad421f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:40 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Volume 8ac3c6b9-7a6f-4465-bff7-06025305cd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27', 'volume_size': 1} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1225794558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac3c6b9-7a6f-4465-bff7-06025305cd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae21433da24d5e8d591a78cddcff83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:08:41Z,use_quota=True,user_id='6ff7293110c54bc79e55979533603b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Creating volume 8ac3c6b9-7a6f-4465-bff7-06025305cd27 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:08:40 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:08:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:40 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 1073741824 Sep 28 05:08:40 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:41 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 1073741824" returned: 0 in 0.555s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:41 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 Sep 28 05:08:41 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:41 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27" returned: 0 in 0.499s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb28dfd-7c93-4728-86c1-36c9ad421f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e6213b-19a5-4127-ace9-2254b7f74963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:08:41 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Volume volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 (8ac3c6b9-7a6f-4465-bff7-06025305cd27): created successfully Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e6213b-19a5-4127-ace9-2254b7f74963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:08:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Flow 'volume_create_manager' (39af35d5-c7d1-439c-b32a-b8f88c8a2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:08:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a858e01e-a33f-4fce-8b8d-4e5f006baa66 tempest-AbsoluteLimitsTests-517105224 None] Created volume successfully. Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Acquiring lock "cinder-8ac3c6b9-7a6f-4465-bff7-06025305cd27-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "cinder-8ac3c6b9-7a6f-4465-bff7-06025305cd27-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Acquiring lock "cinder-quobyte-8ac3c6b9-7a6f-4465-bff7-06025305cd27" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "cinder-quobyte-8ac3c6b9-7a6f-4465-bff7-06025305cd27" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3901dff0-ca36-413a-8fe8-296c67740c88]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:43 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 Sep 28 05:08:43 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:43 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27" returned: 0 in 0.682s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:43 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27 Sep 28 05:08:43 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:44 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ac3c6b9-7a6f-4465-bff7-06025305cd27" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "cinder-quobyte-8ac3c6b9-7a6f-4465-bff7-06025305cd27" released by "delete_volume" :: held 1.137s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Created reservations ['288631f7-ef89-4fdf-9fce-35debc61cd8f', '06928a17-5bd4-4c41-8ba6-41d4ed146746', 'f50a2cb3-e0ab-4bd5-84e2-1080d285a41c', 'ef92531b-def9-44c8-adda-669982d87da6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:44 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:08:44 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:44 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:08:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Deleted volume successfully. Sep 28 05:08:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f098de99-d564-4acc-ad03-91b7c7b3ebd3 tempest-AbsoluteLimitsTests-517105224 None] Lock "cinder-8ac3c6b9-7a6f-4465-bff7-06025305cd27-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-c79f0c98-1ff2-4f5f-bedc-6b33147c2c00 req-3762bdcb-0f2b-4da9-83ac-db57ea4093a1 tempest-AttachVolumeNegativeTest-1992678294 None] Terminate volume connection completed successfully. Sep 28 05:08:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-c79f0c98-1ff2-4f5f-bedc-6b33147c2c00 req-3762bdcb-0f2b-4da9-83ac-db57ea4093a1 tempest-AttachVolumeNegativeTest-1992678294 None] Deleting attachment 87ce248b-2416-4236-8616-7883b7763d6f. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:08:54 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:55 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=11,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:08:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-91af2431-60a7-4d25-810b-6da99052745f req-553e99b4-f9dc-4c23-8e09-07c4a6664b88 tempest-ServerActionsTestOtherA-2048631468 None] Terminate volume connection completed successfully. Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-91af2431-60a7-4d25-810b-6da99052745f req-553e99b4-f9dc-4c23-8e09-07c4a6664b88 tempest-ServerActionsTestOtherA-2048631468 None] Deleting attachment 43595190-9c69-483b-bd72-518f3a82fe2d. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "cinder-fbf81a17-8203-48fb-9cd3-cb737a49823f-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-fbf81a17-8203-48fb-9cd3-cb737a49823f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "cinder-quobyte-fbf81a17-8203-48fb-9cd3-cb737a49823f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-quobyte-fbf81a17-8203-48fb-9cd3-cb737a49823f" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d385a1a0-2173-43d0-991a-fa2173524440]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:08:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:59 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f Sep 28 05:08:59 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:59 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f" returned: 0 in 0.566s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:08:59 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f Sep 28 05:08:59 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:08:59 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 28 05:08:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fbf81a17-8203-48fb-9cd3-cb737a49823f" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:08:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-quobyte-fbf81a17-8203-48fb-9cd3-cb737a49823f" released by "delete_volume" :: held 1.027s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:08:59 devstack cinder-volume[86815]: DEBUG cinder.quota [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Created reservations ['b1884079-2909-4d00-9181-7dc36b23d2b4', 'f499ed8e-3a87-4f85-8a24-0cf8be90ed22', '805aa4c6-d964-44c2-bec1-97c6236dbb08', '6ad6dea4-2764-447c-86b5-8958aa950afc'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:00 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:00 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:00 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.286s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG cinder.manager [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Deleted volume successfully. Sep 28 05:09:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-91af2431-60a7-4d25-810b-6da99052745f req-26fc11f4-360a-41d9-a0eb-1b108a961147 tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-fbf81a17-8203-48fb-9cd3-cb737a49823f-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "cinder-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "cinder-quobyte-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-quobyte-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c527259-2adb-4463-9284-8d22daba9b6b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:01 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 Sep 28 05:09:01 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:01 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" returned: 0 in 0.426s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:01 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5 Sep 28 05:09:01 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:02 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-quobyte-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5" released by "delete_volume" :: held 0.943s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Created reservations ['a9c1f8b6-0cb1-4017-b5a9-e5d3310b2600', 'ccef69af-d55b-4264-a551-0f8013dbcf1c', '339630a9-63eb-4e47-91b1-891f41a2bb40', 'a8e5d5ba-b814-4838-bf7d-1bcbbb58fb4d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:02 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:02 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:03 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.506s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Deleted volume successfully. Sep 28 05:09:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fca65d37-1c66-42ee-870c-72d7033cadbd tempest-ServerActionsTestOtherA-2048631468 None] Lock "cinder-ac7fc9a8-baf1-45ef-8d2e-6751bee2f7a5-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Flow 'volume_create_manager' (2c3938c0-19fe-4f26-aaae-ad4f7eeda239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62ea253-3edb-42b8-b9ba-2ab77d3c6c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62ea253-3edb-42b8-b9ba-2ab77d3c6c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575877265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3804d530-65a9-4729-9835-6af8cc4a6675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee20bead63824683a32956908e3dbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:12Z,use_quota=True,user_id='ce260fff69c74ef49f40702142a51a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb1fc52-4abd-4a67-a30c-8f9b4984f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb1fc52-4abd-4a67-a30c-8f9b4984f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3531f61-d0d3-4dc7-ab8d-8ba9109b763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3531f61-d0d3-4dc7-ab8d-8ba9109b763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3804d530-65a9-4729-9835-6af8cc4a6675', 'volume_name': 'volume-3804d530-65a9-4729-9835-6af8cc4a6675', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8a09c-9d5a-4310-aff6-68e2cdb88b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd8a09c-9d5a-4310-aff6-68e2cdb88b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a7f549-4440-4580-90c1-c2907c51243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Volume 3804d530-65a9-4729-9835-6af8cc4a6675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3804d530-65a9-4729-9835-6af8cc4a6675', 'volume_size': 1} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575877265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3804d530-65a9-4729-9835-6af8cc4a6675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee20bead63824683a32956908e3dbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:12Z,use_quota=True,user_id='ce260fff69c74ef49f40702142a51a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Creating volume 3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:11 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:12 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 1073741824 Sep 28 05:09:12 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:13 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 1073741824" returned: 0 in 1.141s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:13 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:09:13 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:13 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.682s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a7f549-4440-4580-90c1-c2907c51243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3804d530-65a9-4729-9835-6af8cc4a6675', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d074fb-1426-4af7-b84e-ec858a90c0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Volume volume-3804d530-65a9-4729-9835-6af8cc4a6675 (3804d530-65a9-4729-9835-6af8cc4a6675): created successfully Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d074fb-1426-4af7-b84e-ec858a90c0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Flow 'volume_create_manager' (2c3938c0-19fe-4f26-aaae-ad4f7eeda239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e615132a-b85f-4792-9696-425c496a12e9 tempest-VolumesActionsTest-1161518360 None] Created volume successfully. Sep 28 05:09:23 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:09:24 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:29 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:29 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:29 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:09:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Flow 'volume_create_manager' (cbff3d57-10d3-4f2f-b189-ee17c19a5033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6f9ce0-fca0-4f02-8bc8-8cba998cf378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6f9ce0-fca0-4f02-8bc8-8cba998cf378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-650350421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dc2811-2e72-4f25-94cb-09e2baee5243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de87702268140a8ba9f9a73b351ffb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:30Z,use_quota=True,user_id='b51b3f7a1bda4eb3be364e39d647921c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e092de-37cf-4f5f-9b47-61a352ecc41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e092de-37cf-4f5f-9b47-61a352ecc41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b74061-1c35-4a2a-8cb2-78f6261cd6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b74061-1c35-4a2a-8cb2-78f6261cd6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dc2811-2e72-4f25-94cb-09e2baee5243', 'volume_name': 'volume-84dc2811-2e72-4f25-94cb-09e2baee5243', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bdf9c5-0c25-4596-b6d8-ba62fb80741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bdf9c5-0c25-4596-b6d8-ba62fb80741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2a78f4-fb8e-4aa3-8aed-a84d068ba74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:30 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Volume 84dc2811-2e72-4f25-94cb-09e2baee5243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dc2811-2e72-4f25-94cb-09e2baee5243', 'volume_size': 1} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-650350421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dc2811-2e72-4f25-94cb-09e2baee5243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de87702268140a8ba9f9a73b351ffb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:30Z,use_quota=True,user_id='b51b3f7a1bda4eb3be364e39d647921c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Creating volume 84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:30 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:30 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 1073741824 Sep 28 05:09:30 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:31 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 1073741824" returned: 0 in 0.729s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:31 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 Sep 28 05:09:31 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:31 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2a78f4-fb8e-4aa3-8aed-a84d068ba74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dc2811-2e72-4f25-94cb-09e2baee5243', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff2da5f-de0c-42bb-b2e6-d2c23174b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:31 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Volume volume-84dc2811-2e72-4f25-94cb-09e2baee5243 (84dc2811-2e72-4f25-94cb-09e2baee5243): created successfully Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff2da5f-de0c-42bb-b2e6-d2c23174b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Flow 'volume_create_manager' (cbff3d57-10d3-4f2f-b189-ee17c19a5033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-3626b7f1-d3fc-4c42-9292-39dba1224087 req-7250f81a-ba6f-4ce3-8398-66472bfde6ba tempest-VolumesSnapshotsTestJSON-459119290 None] Created volume successfully. Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Flow 'volume_create_manager' (93c27bbb-3ee1-45b3-a177-c1febb94d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7facd-aa83-42ef-b6ba-ad3375e89208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7facd-aa83-42ef-b6ba-ad3375e89208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847135708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82d1a5-5d6c-4e78-85a6-b651da910ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ee5868f9e545339c8c33bc8ba8b501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:33Z,use_quota=True,user_id='cef0c4a391a54e489b440d4c1ea38115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200de21e-5f59-451a-beb1-6c25b7032b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200de21e-5f59-451a-beb1-6c25b7032b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6ed43-7603-4ff4-a0a6-b9399658679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6ed43-7603-4ff4-a0a6-b9399658679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e82d1a5-5d6c-4e78-85a6-b651da910ed1', 'volume_name': 'volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1789fbf7-2d5e-43b3-9632-bf8251a9a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1789fbf7-2d5e-43b3-9632-bf8251a9a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d12713-9a3e-4f69-baa0-11ef4364e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Volume 9e82d1a5-5d6c-4e78-85a6-b651da910ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1', 'volume_size': 1} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847135708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82d1a5-5d6c-4e78-85a6-b651da910ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ee5868f9e545339c8c33bc8ba8b501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:33Z,use_quota=True,user_id='cef0c4a391a54e489b440d4c1ea38115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Creating volume 9e82d1a5-5d6c-4e78-85a6-b651da910ed1 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:32 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:33 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 1073741824 Sep 28 05:09:33 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-977fbc46-dd98-4ddc-8147-994c34ceefc0 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" by "attach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-977fbc46-dd98-4ddc-8147-994c34ceefc0 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" acquired by "attach_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-977fbc46-dd98-4ddc-8147-994c34ceefc0 tempest-VolumesActionsTest-1161518360 None] Attaching volume 3804d530-65a9-4729-9835-6af8cc4a6675 to instance 55bc28f8-0ec2-46fb-90e2-cef244d424fd at mountpoint /dev/vdb on host None. Sep 28 05:09:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-977fbc46-dd98-4ddc-8147-994c34ceefc0 tempest-VolumesActionsTest-1161518360 None] Attach volume completed successfully. Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-977fbc46-dd98-4ddc-8147-994c34ceefc0 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" released by "attach_volume" :: held 0.100s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:33 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 1073741824" returned: 0 in 0.619s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:33 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 Sep 28 05:09:33 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-84ea561c-59ab-4c0c-84ca-21055c83cb5a tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" by "detach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-84ea561c-59ab-4c0c-84ca-21055c83cb5a tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-84ea561c-59ab-4c0c-84ca-21055c83cb5a tempest-VolumesActionsTest-1161518360 None] Detaching volume 3804d530-65a9-4729-9835-6af8cc4a6675 from instance 55bc28f8-0ec2-46fb-90e2-cef244d424fd. Sep 28 05:09:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-84ea561c-59ab-4c0c-84ca-21055c83cb5a tempest-VolumesActionsTest-1161518360 None] Detach volume completed successfully. Sep 28 05:09:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-84ea561c-59ab-4c0c-84ca-21055c83cb5a tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:34 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" returned: 0 in 0.398s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.899s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d12713-9a3e-4f69-baa0-11ef4364e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4235c74-7638-44fc-ba12-39209ec11114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Creating offline snapshot ac83800f-3039-433e-ae0f-c2fc5fd1c205 of volume 84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:09:34 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Volume volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 (9e82d1a5-5d6c-4e78-85a6-b651da910ed1): created successfully Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4235c74-7638-44fc-ba12-39209ec11114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Flow 'volume_create_manager' (93c27bbb-3ee1-45b3-a177-c1febb94d030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f40356-ccaa-4507-b124-25c285758c85]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ee8906e4-a996-452f-a511-5956b6472020 tempest-ServersNegativeTestJSON-1881097783 None] Created volume successfully. Sep 28 05:09:34 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 Sep 28 05:09:34 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:34 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:34 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 1G Sep 28 05:09:34 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:35 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 1G" returned: 0 in 0.785s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dc2811-2e72-4f25-94cb-09e2baee5243 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:35 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dc2811-2e72-4f25-94cb-09e2baee5243 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 Sep 28 05:09:35 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:36 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84dc2811-2e72-4f25-94cb-09e2baee5243 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205" returned: 0 in 0.608s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:36 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 is being set with open permissions: ugo+rw Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:36 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 Sep 28 05:09:36 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:36 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205" returned: 0 in 0.410s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:36 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info Sep 28 05:09:36 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:36 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:36 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info is being set with open permissions: ugo+rw Sep 28 05:09:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:36 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info Sep 28 05:09:36 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:37 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.info" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-543f7dc3-6fa3-4d27-83a5-91c57f4ddfa4 req-3a858740-2dc4-47a9-bb0c-05f0451e417b tempest-VolumesSnapshotsTestJSON-459119290 None] Create snapshot completed successfully Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Flow 'volume_create_manager' (2c6cf3be-ec63-42a2-b160-e2d32f167bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f379ca-f7a4-482a-8aa6-af52eb0e75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f379ca-f7a4-482a-8aa6-af52eb0e75b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1875176182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fae368-545a-4ad7-8dfd-77f5ca52e981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ee5868f9e545339c8c33bc8ba8b501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:37Z,use_quota=True,user_id='cef0c4a391a54e489b440d4c1ea38115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93288c89-eb68-4777-a7af-740c6086e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93288c89-eb68-4777-a7af-740c6086e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319b1d4-4ee9-4d0d-a5e6-b5dbed8d9a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4319b1d4-4ee9-4d0d-a5e6-b5dbed8d9a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fae368-545a-4ad7-8dfd-77f5ca52e981', 'volume_name': 'volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188cfe71-7542-4e9a-a96b-d4eb80fba3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188cfe71-7542-4e9a-a96b-d4eb80fba3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad1262a-ae03-4684-ac8d-7827dc1a60bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Volume c4fae368-545a-4ad7-8dfd-77f5ca52e981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981', 'volume_size': 1} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1875176182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fae368-545a-4ad7-8dfd-77f5ca52e981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ee5868f9e545339c8c33bc8ba8b501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:37Z,use_quota=True,user_id='cef0c4a391a54e489b440d4c1ea38115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Creating volume c4fae368-545a-4ad7-8dfd-77f5ca52e981 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:37 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 1073741824 Sep 28 05:09:37 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "cinder-ac83800f-3039-433e-ae0f-c2fc5fd1c205-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-ac83800f-3039-433e-ae0f-c2fc5fd1c205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (f3e68c42-9e66-4d02-a281-077d2e6326a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60b01c9-8b7b-4163-b04f-e45bc3671e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "cinder-quobyte-ac83800f-3039-433e-ae0f-c2fc5fd1c205" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:37 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60b01c9-8b7b-4163-b04f-e45bc3671e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905081038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc7c713-7cca-43f1-a94e-7ddef7e9bc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:38Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156428a3-fd94-4af3-b64c-59a55a94ced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156428a3-fd94-4af3-b64c-59a55a94ced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5d9dde-5a5b-4632-9fb4-737be36bec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5d9dde-5a5b-4632-9fb4-737be36bec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc7c713-7cca-43f1-a94e-7ddef7e9bc33', 'volume_name': 'volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd50155-3e17-448d-b2f3-1ba973e5f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd50155-3e17-448d-b2f3-1ba973e5f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fba9608-6095-430a-896b-1c05191f8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Volume abc7c713-7cca-43f1-a94e-7ddef7e9bc33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33', 'volume_size': 1} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-ac83800f-3039-433e-ae0f-c2fc5fd1c205" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Deleting offline snapshot ac83800f-3039-433e-ae0f-c2fc5fd1c205 of volume 84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] snapshot_file for this snap is: volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 1073741824" returned: 0 in 0.684s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59df7ba-8b31-4b28-a214-ca928fdd5568]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 Sep 28 05:09:38 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:38 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 Sep 28 05:09:38 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:38 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905081038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc7c713-7cca-43f1-a94e-7ddef7e9bc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:38Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Creating volume abc7c713-7cca-43f1-a94e-7ddef7e9bc33 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:38 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad1262a-ae03-4684-ac8d-7827dc1a60bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:38 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 1073741824 Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fb061e-17fc-47e6-a16a-63cce43b1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:38 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Volume volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 (c4fae368-545a-4ad7-8dfd-77f5ca52e981): created successfully Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fb061e-17fc-47e6-a16a-63cce43b1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Flow 'volume_create_manager' (2c6cf3be-ec63-42a2-b160-e2d32f167bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-27f7ee5f-6d76-4b46-a21b-2da7c3c29f93 tempest-ServersNegativeTestJSON-1881097783 None] Created volume successfully. Sep 28 05:09:38 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205" returned: 0 in 0.439s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84dc2811-2e72-4f25-94cb-09e2baee5243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ff8ad-16d7-4f78-936f-6f028afd599f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 Sep 28 05:09:38 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:38 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 1073741824" returned: 0 in 0.537s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:38 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243" returned: 0 in 0.430s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:38 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 Sep 28 05:09:38 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:39 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 Sep 28 05:09:39 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:39 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" returned: 0 in 0.349s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fba9608-6095-430a-896b-1c05191f8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1cb233-06bf-4abb-9ffa-a6642eb96616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Volume volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 (abc7c713-7cca-43f1-a94e-7ddef7e9bc33): created successfully Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1cb233-06bf-4abb-9ffa-a6642eb96616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (f3e68c42-9e66-4d02-a281-077d2e6326a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e554118c-523a-4ded-ba3d-d7553b1bfdbc tempest-AttachVolumeNegativeTest-1992678294 None] Created volume successfully. Sep 28 05:09:39 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205" returned: 0 in 0.488s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:39 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205 Sep 28 05:09:39 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:39 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243.ac83800f-3039-433e-ae0f-c2fc5fd1c205" returned: 0 in 0.417s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "cinder-c4fae368-545a-4ad7-8dfd-77f5ca52e981-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-ac83800f-3039-433e-ae0f-c2fc5fd1c205" released by "_delete_snapshot" :: held 1.959s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-c4fae368-545a-4ad7-8dfd-77f5ca52e981-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" released by "delete_snapshot" :: held 2.065s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "cinder-quobyte-c4fae368-545a-4ad7-8dfd-77f5ca52e981" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-quobyte-c4fae368-545a-4ad7-8dfd-77f5ca52e981" acquired by "delete_volume" :: waited 0.037s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef69d92-ba05-4ada-a469-bbd81c9009e2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG cinder.quota [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Created reservations ['963f83c9-5880-4927-8464-64e4ef7a14f7', '6576d5f7-eb11-4a0d-9746-2e4449585ecc', 'f21e2709-ab9b-459c-8d22-2fbd4fb3951f', '26c496ad-2b53-4e89-a48d-fb25931aef3f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Delete snapshot completed successfully. Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-22a625a3-c0d5-4af8-afcc-502a941b409f req-ce78cc7b-7516-403a-9d2a-21172a4870e2 tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-ac83800f-3039-433e-ae0f-c2fc5fd1c205-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:40 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 Sep 28 05:09:40 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:40 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981" returned: 0 in 0.744s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:40 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981 Sep 28 05:09:40 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-81b5a4f9-5a9d-4c7e-8c3f-559d8f245905 req-5d1918a5-59a5-41ec-9d32-cac2546f22b7 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-81b5a4f9-5a9d-4c7e-8c3f-559d8f245905 req-5d1918a5-59a5-41ec-9d32-cac2546f22b7 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-81b5a4f9-5a9d-4c7e-8c3f-559d8f245905 req-5d1918a5-59a5-41ec-9d32-cac2546f22b7 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-81b5a4f9-5a9d-4c7e-8c3f-559d8f245905 req-5d1918a5-59a5-41ec-9d32-cac2546f22b7 tempest-AttachVolumeNegativeTest-1992678294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c423a158-7905-43b6-b4b6-77caa47af441', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:09:41 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c4fae368-545a-4ad7-8dfd-77f5ca52e981" returned: 0 in 0.333s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-81b5a4f9-5a9d-4c7e-8c3f-559d8f245905 req-5d1918a5-59a5-41ec-9d32-cac2546f22b7 tempest-AttachVolumeNegativeTest-1992678294 None] attachment_update completed successfully. Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "cinder-84dc2811-2e72-4f25-94cb-09e2baee5243-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-quobyte-c4fae368-545a-4ad7-8dfd-77f5ca52e981" released by "delete_volume" :: held 1.170s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-84dc2811-2e72-4f25-94cb-09e2baee5243-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Created reservations ['5ccdc575-12e6-4c88-9171-4de58903a76b', '499c1cd7-56e1-4197-a401-e0966a280d8f', 'a773a72d-6f3b-4638-8c03-54794d5091bd', 'fc7749f4-582e-4480-b32b-1e82c0bf9975'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" acquired by "delete_volume" :: waited 0.053s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cb1393-fbb5-4280-b64a-550d15392c43]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:41 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:41 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:41 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 Sep 28 05:09:41 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:41 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.382s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:41 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Deleted volume successfully. Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-019d9a47-469d-41e6-b0d5-43b52b777a4c tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-c4fae368-545a-4ad7-8dfd-77f5ca52e981-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:42 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243" returned: 0 in 0.621s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:42 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243 Sep 28 05:09:42 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "cinder-9e82d1a5-5d6c-4e78-85a6-b651da910ed1-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-9e82d1a5-5d6c-4e78-85a6-b651da910ed1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "cinder-quobyte-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-quobyte-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7028f7-7943-44d3-81c4-2f490ebd0a87]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:42 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-84dc2811-2e72-4f25-94cb-09e2baee5243" returned: 0 in 0.457s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-quobyte-84dc2811-2e72-4f25-94cb-09e2baee5243" released by "delete_volume" :: held 1.171s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:42 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 Sep 28 05:09:42 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.quota [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Created reservations ['d46c6bc8-9f0d-4f9a-a308-b156cb60760d', '9d56dd10-ade1-48df-9739-212c782d384f', 'c0900445-a12b-4030-b751-36e8f7482203', '984f9f00-3a7a-450d-baf9-d607a2a55e96'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:42 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:42 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:42 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" returned: 0 in 0.498s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:43 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1 Sep 28 05:09:43 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:43 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.manager [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Deleted volume successfully. Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-33edb28b-760a-4fe0-a4a2-1239e2a0b276 req-07cedca0-6240-4cf1-9077-222d8ca8585c tempest-VolumesSnapshotsTestJSON-459119290 None] Lock "cinder-84dc2811-2e72-4f25-94cb-09e2baee5243-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:43 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" returned: 0 in 0.460s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-quobyte-9e82d1a5-5d6c-4e78-85a6-b651da910ed1" released by "delete_volume" :: held 1.069s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Created reservations ['9c217a46-5527-4484-a516-8f1ccdc77c94', 'd75345bd-ceeb-492a-ab7d-f7e87636f9e1', '6d3e4d13-55b8-4355-b46c-a134eca60433', '31104eb9-883c-4586-b21d-ddb708de7260'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:43 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:09:43 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:44 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.541s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:44 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:09:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Deleted volume successfully. Sep 28 05:09:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e2de4d8c-c732-4a6a-8779-53da910d5ed7 tempest-ServersNegativeTestJSON-1881097783 None] Lock "cinder-9e82d1a5-5d6c-4e78-85a6-b651da910ed1-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-ee1504f6-053c-453d-9ff9-09b7cd280132 req-df7648ec-5d6a-4340-bbb7-2d742139036d tempest-AttachVolumeNegativeTest-1992678294 None] Terminate volume connection completed successfully. Sep 28 05:09:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-ee1504f6-053c-453d-9ff9-09b7cd280132 req-df7648ec-5d6a-4340-bbb7-2d742139036d tempest-AttachVolumeNegativeTest-1992678294 None] Deleting attachment c423a158-7905-43b6-b4b6-77caa47af441. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:09:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9d701fbe-2ea9-4892-8e4f-c81f86b645e1 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" by "attach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9d701fbe-2ea9-4892-8e4f-c81f86b645e1 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" acquired by "attach_volume" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9d701fbe-2ea9-4892-8e4f-c81f86b645e1 tempest-VolumesActionsTest-1161518360 None] Attaching volume 3804d530-65a9-4729-9835-6af8cc4a6675 to instance d7ed3a35-6df3-4174-877a-24b0a5ec700b at mountpoint /dev/vdb on host None. Sep 28 05:09:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9d701fbe-2ea9-4892-8e4f-c81f86b645e1 tempest-VolumesActionsTest-1161518360 None] Attach volume completed successfully. Sep 28 05:09:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9d701fbe-2ea9-4892-8e4f-c81f86b645e1 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675" released by "attach_volume" :: held 0.164s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c28e113f-79cc-46c6-b4a0-3ae78b72fbd6 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" by "detach_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:09:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c28e113f-79cc-46c6-b4a0-3ae78b72fbd6 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:09:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c28e113f-79cc-46c6-b4a0-3ae78b72fbd6 tempest-VolumesActionsTest-1161518360 None] Detaching volume 3804d530-65a9-4729-9835-6af8cc4a6675 from instance d7ed3a35-6df3-4174-877a-24b0a5ec700b. Sep 28 05:09:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c28e113f-79cc-46c6-b4a0-3ae78b72fbd6 tempest-VolumesActionsTest-1161518360 None] Detach volume completed successfully. Sep 28 05:09:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c28e113f-79cc-46c6-b4a0-3ae78b72fbd6 tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (54020312-fb27-43b9-9ebb-a2c3f53a4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3afc953-af34-468f-afd1-a5a06be69158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3afc953-af34-468f-afd1-a5a06be69158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2975253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69be259-bb16-455e-a845-3fdf177d4a4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:52Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bd870d-e657-44f6-ac38-8ed9d48e4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bd870d-e657-44f6-ac38-8ed9d48e4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ab7827-fce7-4e7b-9f57-6573214f26e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ab7827-fce7-4e7b-9f57-6573214f26e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69be259-bb16-455e-a845-3fdf177d4a4f', 'volume_name': 'volume-b69be259-bb16-455e-a845-3fdf177d4a4f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448fb14b-0bda-4f7e-88c7-e696ecff6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448fb14b-0bda-4f7e-88c7-e696ecff6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a0feee-1457-40bc-a271-c37a197b8ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Volume b69be259-bb16-455e-a845-3fdf177d4a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69be259-bb16-455e-a845-3fdf177d4a4f', 'volume_size': 1} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2975253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69be259-bb16-455e-a845-3fdf177d4a4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:52Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Creating volume b69be259-bb16-455e-a845-3fdf177d4a4f {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:52 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:52 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f 1073741824 Sep 28 05:09:52 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:52 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f 1073741824" returned: 0 in 0.623s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:52 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f Sep 28 05:09:52 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:52 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a0feee-1457-40bc-a271-c37a197b8ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69be259-bb16-455e-a845-3fdf177d4a4f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aed1453-50af-4c33-9892-267b457c611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:53 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Volume volume-b69be259-bb16-455e-a845-3fdf177d4a4f (b69be259-bb16-455e-a845-3fdf177d4a4f): created successfully Sep 28 05:09:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aed1453-50af-4c33-9892-267b457c611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:53 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (54020312-fb27-43b9-9ebb-a2c3f53a4951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:53 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-94f962e5-f369-4025-8716-0cec16a16eba tempest-VolumesTestJSON-345716275 None] Created volume successfully. Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (3eba30bd-4e5b-4680-a885-d9c0e034b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2962835-96a4-4575-b273-b588e014170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2962835-96a4-4575-b273-b588e014170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1307891710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7425ace-c38c-4196-97cc-1aec3b7a1fc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:55Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229dbd7f-f97e-4a12-87d7-812410fdd160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229dbd7f-f97e-4a12-87d7-812410fdd160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f4ce9e-ca26-4260-86f3-b470a7b9334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f4ce9e-ca26-4260-86f3-b470a7b9334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7425ace-c38c-4196-97cc-1aec3b7a1fc5', 'volume_name': 'volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa50b6-6071-497d-ac63-04c12cca2e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa50b6-6071-497d-ac63-04c12cca2e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6f9c86-7350-4b10-b026-2182388647df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:54 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Volume e7425ace-c38c-4196-97cc-1aec3b7a1fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5', 'volume_size': 1} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1307891710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7425ace-c38c-4196-97cc-1aec3b7a1fc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:55Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Creating volume e7425ace-c38c-4196-97cc-1aec3b7a1fc5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:09:54 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:09:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:54 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 1073741824 Sep 28 05:09:54 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:55 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 1073741824" returned: 0 in 0.561s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:55 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 Sep 28 05:09:55 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:55 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" returned: 0 in 0.437s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6f9c86-7350-4b10-b026-2182388647df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1ca3ec-264b-4742-806f-5201c523c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Volume volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 (e7425ace-c38c-4196-97cc-1aec3b7a1fc5): created successfully Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1ca3ec-264b-4742-806f-5201c523c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (3eba30bd-4e5b-4680-a885-d9c0e034b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ad794f0b-3a74-4246-988e-0c76dd8824cf tempest-VolumesTestJSON-345716275 None] Created volume successfully. Sep 28 05:09:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:09:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e790e-348e-4156-8188-23e511f87ab7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:57 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:09:57 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (46bc33d0-f5b5-45a7-b5c3-00330112f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:09:57 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00b165c-4bca-4c8d-9222-baea9d7e4e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.557s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00b165c-4bca-4c8d-9222-baea9d7e4e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-5139884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36acb391-9a40-4316-a8e1-4065e2a8b3ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:57Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad912e1c-4e0c-4151-bea7-ec9dc19a10c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad912e1c-4e0c-4151-bea7-ec9dc19a10c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5888338-0563-4ae9-99d4-4842ea5e6b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5888338-0563-4ae9-99d4-4842ea5e6b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36acb391-9a40-4316-a8e1-4065e2a8b3ff', 'volume_name': 'volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fc053-bc29-4acf-818b-c77d435d1464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fc053-bc29-4acf-818b-c77d435d1464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a52e6c7-58c4-4ab3-9906-2dd70ec50a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:09:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Volume 36acb391-9a40-4316-a8e1-4065e2a8b3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff', 'volume_size': 1} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[816cdce5-1db2-4dd4-979b-ae4910b841ff]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:57 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:09:57 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:09:57 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:09:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.b59523f9-60c9-4394-9bb6-3a956a8608b1o4vin07g.img {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:09:58 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.b59523f9-60c9-4394-9bb6-3a956a8608b1o4vin07g.img Sep 28 05:09:58 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:05 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=55,cinder:INSERT=13,cinder:UPDATE=56,cinder:DELETE=8 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:10:07 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.b59523f9-60c9-4394-9bb6-3a956a8608b1o4vin07g.img" returned: 0 in 9.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[031bd56f-bf06-40e7-beb3-675cd4782330]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:07 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:07 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=58,cinder:SELECT=61,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:10:07 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.713s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675, size 1024.00 MB, duration 9.27 sec, destination /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.b59523f9-60c9-4394-9bb6-3a956a8608b1o4vin07g.img {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:10:07 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Converted 1024.00 MB image at 110.44 MB/s Sep 28 05:10:07 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] b59523f9-60c9-4394-9bb6-3a956a8608b1 was raw, no need to convert to raw {{(pid=86815) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 05:10:17 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:10:17 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:29 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:29 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:30 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.795s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:30 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:10:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:10:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:10:31 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:10:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (ffcf5e28-72b6-4181-b66a-c4f6d0aa928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf32924-4337-4143-b196-dc87c6bd9b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf32924-4337-4143-b196-dc87c6bd9b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-748143465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5878f7ea-09e3-40b1-bb04-08c11620a779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:32Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72e8755-99b0-4e5c-b22b-f103221af45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72e8755-99b0-4e5c-b22b-f103221af45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c33dc-f4ad-4703-914f-e3f27edfd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c33dc-f4ad-4703-914f-e3f27edfd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5878f7ea-09e3-40b1-bb04-08c11620a779', 'volume_name': 'volume-5878f7ea-09e3-40b1-bb04-08c11620a779', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ab8a02-56c7-4346-9585-5718dc3239f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ab8a02-56c7-4346-9585-5718dc3239f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99845e3c-2535-4eec-bf07-bb471e34a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Volume 5878f7ea-09e3-40b1-bb04-08c11620a779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5878f7ea-09e3-40b1-bb04-08c11620a779', 'volume_size': 1} Sep 28 05:10:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.563s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Uploaded volume to glance image-id: b59523f9-60c9-4394-9bb6-3a956a8608b1. {{(pid=86815) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.913s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-5139884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36acb391-9a40-4316-a8e1-4065e2a8b3ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2c427f5ce24b34875fee8b2b3d5571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:09:57Z,use_quota=True,user_id='f9b2d18ee370486dad963d058130435e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Creating volume 36acb391-9a40-4316-a8e1-4065e2a8b3ff {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:10:34 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:34 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff 1073741824 Sep 28 05:10:34 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-616e725b-67ed-425f-b86d-0a0a5cdd77da tempest-VolumesActionsTest-1161518360 None] Copy volume to image completed successfully. Sep 28 05:10:34 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff 1073741824" returned: 0 in 0.448s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:34 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff Sep 28 05:10:34 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:35 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff" returned: 0 in 0.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-748143465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5878f7ea-09e3-40b1-bb04-08c11620a779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae484fee80894152a8884880d48ac220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:32Z,use_quota=True,user_id='67c5fa5eaa094cf290aebb1d8a7a4839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Creating volume 5878f7ea-09e3-40b1-bb04-08c11620a779 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:10:35 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:35 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 1073741824 Sep 28 05:10:35 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a52e6c7-58c4-4ab3-9906-2dd70ec50a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1283ef51-e01b-4091-beb4-74c4f2d0ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:35 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Volume volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff (36acb391-9a40-4316-a8e1-4065e2a8b3ff): created successfully Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1283ef51-e01b-4091-beb4-74c4f2d0ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Flow 'volume_create_manager' (46bc33d0-f5b5-45a7-b5c3-00330112f312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f91e7df8-91c2-488a-b30f-fe2461d94068 tempest-VolumesTestJSON-345716275 None] Created volume successfully. Sep 28 05:10:35 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 1073741824" returned: 0 in 0.448s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:35 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 Sep 28 05:10:35 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:35 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:10:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99845e3c-2535-4eec-bf07-bb471e34a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5878f7ea-09e3-40b1-bb04-08c11620a779', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300aa29-5d57-416b-8b77-f1b344b4001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:36 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Volume volume-5878f7ea-09e3-40b1-bb04-08c11620a779 (5878f7ea-09e3-40b1-bb04-08c11620a779): created successfully Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300aa29-5d57-416b-8b77-f1b344b4001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Flow 'volume_create_manager' (ffcf5e28-72b6-4181-b66a-c4f6d0aa928c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-79ef64c5-97b5-446d-a05c-c0958f8a44c9 tempest-AttachVolumeNegativeTest-1992678294 None] Created volume successfully. Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef675d-dfe0-4807-9a18-b7027a76ecbf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:36 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:36 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:36 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.378s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c70c1-50c6-43b3-a352-047ce457f2f3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:36 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:36 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:37 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.462s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:37 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img Sep 28 05:10:37 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-36acb391-9a40-4316-a8e1-4065e2a8b3ff-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "cinder-36acb391-9a40-4316-a8e1-4065e2a8b3ff-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-quobyte-36acb391-9a40-4316-a8e1-4065e2a8b3ff" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-36acb391-9a40-4316-a8e1-4065e2a8b3ff" acquired by "delete_volume" :: waited 0.069s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f425a02-3bba-420f-b7d3-386e48955310]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:38 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff Sep 28 05:10:38 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-aa654b3d-4987-4e0c-a3d7-96d67ab4be77 req-0a49cf2f-a781-437f-98b0-a423abedde83 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:39 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff" returned: 0 in 0.972s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:39 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff Sep 28 05:10:39 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:39 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36acb391-9a40-4316-a8e1-4065e2a8b3ff" returned: 0 in 0.738s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-36acb391-9a40-4316-a8e1-4065e2a8b3ff" released by "delete_volume" :: held 1.836s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Created reservations ['2c50209a-9aac-4e7e-9728-283104ca1bc6', '523dc2fb-c983-4c5b-bac2-458aca485942', '4e95f899-cb46-4cce-bfef-42a997a3e2d3', 'd664e8f4-097a-404b-97c7-2a021a4e173e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:40 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:40 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-e7425ace-c38c-4196-97cc-1aec3b7a1fc5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "cinder-e7425ace-c38c-4196-97cc-1aec3b7a1fc5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-quobyte-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1067e5-7821-4ea4-abf9-bc68d7f9b614]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:41 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 Sep 28 05:10:41 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:41 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.729s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:41 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Deleted volume successfully. Sep 28 05:10:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-32405fd0-cd82-4d4a-90ba-75c958fc86a9 tempest-VolumesTestJSON-345716275 None] Lock "cinder-36acb391-9a40-4316-a8e1-4065e2a8b3ff-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:41 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" returned: 0 in 0.937s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:41 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5 Sep 28 05:10:41 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:42 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" returned: 0 in 0.494s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-e7425ace-c38c-4196-97cc-1aec3b7a1fc5" released by "delete_volume" :: held 1.566s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Created reservations ['34dc4c59-e129-4f72-bf74-8e5f85288855', 'a90695f3-9507-4bf2-9513-09a937887a39', '53cdcc96-25cf-49d8-9001-c01bb3e13c9f', 'aebaafe6-4248-4202-8aa4-d61de4bb33c5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:42 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:42 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:42 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Deleted volume successfully. Sep 28 05:10:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dc17b411-abb3-4058-add4-d4b409464cfb tempest-VolumesTestJSON-345716275 None] Lock "cinder-e7425ace-c38c-4196-97cc-1aec3b7a1fc5-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-b69be259-bb16-455e-a845-3fdf177d4a4f-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "cinder-b69be259-bb16-455e-a845-3fdf177d4a4f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Acquiring lock "cinder-quobyte-b69be259-bb16-455e-a845-3fdf177d4a4f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-b69be259-bb16-455e-a845-3fdf177d4a4f" acquired by "delete_volume" :: waited 0.039s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f810c0-05e3-401d-b1f6-3f403f3c5323]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:43 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f Sep 28 05:10:43 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:44 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f" returned: 0 in 0.606s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:44 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f Sep 28 05:10:44 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:44 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b69be259-bb16-455e-a845-3fdf177d4a4f" returned: 0 in 0.338s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "cinder-quobyte-b69be259-bb16-455e-a845-3fdf177d4a4f" released by "delete_volume" :: held 1.043s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Created reservations ['7ea07ca3-7a9f-4bef-9622-adf83169c45e', 'bdd5d1fa-9102-45d3-8d4f-e7676599cce6', '7667f433-a217-4b69-ae4c-a611a4267baa', 'd8679182-919a-496f-b0d3-897c9bb549ac'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:44 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:44 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:45 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.345s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Deleted volume successfully. Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1c1c6614-0aee-4893-8f74-9a2419834a1c tempest-VolumesTestJSON-345716275 None] Lock "cinder-b69be259-bb16-455e-a845-3fdf177d4a4f-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:45 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img" returned: 0 in 8.600s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675cc56-fb13-4ff2-bacf-8cbfbb62e033]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:45 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:45 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:46 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.577s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675, size 1024.00 MB, duration 8.60 sec, destination /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:10:46 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Converted 1024.00 MB image at 119.05 MB/s Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] e63d7940-ab0e-4187-a5de-d955dfc32b04 was raw, converting to qcow2 {{(pid=86815) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab72982-8583-430f-a4c2-0516e6c6fc25]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:46 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img Sep 28 05:10:46 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:46 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img" returned: 0 in 0.363s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:46 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img Sep 28 05:10:46 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:47 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img" returned: 1 in 0.347s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img /opt/stack/data/cinder/conversion/vol_upload_guyv87vk {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:47 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img /opt/stack/data/cinder/conversion/vol_upload_guyv87vk Sep 28 05:10:47 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:47 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img /opt/stack/data/cinder/conversion/vol_upload_guyv87vk" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Image conversion details: src /opt/stack/data/cinder/conversion/3804d530-65a9-4729-9835-6af8cc4a6675.temp_image.e63d7940-ab0e-4187-a5de-d955dfc32b0498w2jbzn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_guyv87vk {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:10:47 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae65ab9b-f524-462f-9c19-7c7b8f6453e3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_guyv87vk {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:47 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_guyv87vk Sep 28 05:10:47 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:47 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_guyv87vk" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.862s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Uploaded volume to glance image-id: e63d7940-ab0e-4187-a5de-d955dfc32b04. {{(pid=86815) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 05:10:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-aa654b3d-4987-4e0c-a3d7-96d67ab4be77 req-0a49cf2f-a781-437f-98b0-a423abedde83 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.395s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-aa654b3d-4987-4e0c-a3d7-96d67ab4be77 req-0a49cf2f-a781-437f-98b0-a423abedde83 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d4cd3255-bced-4423-8fed-366a9852c867 tempest-VolumesActionsTest-1161518360 None] Copy volume to image completed successfully. Sep 28 05:10:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-aa654b3d-4987-4e0c-a3d7-96d67ab4be77 req-0a49cf2f-a781-437f-98b0-a423abedde83 tempest-AttachVolumeNegativeTest-1992678294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-5878f7ea-09e3-40b1-bb04-08c11620a779', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67c2309b-8000-4c73-a4b1-312cc411d37e', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:10:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-aa654b3d-4987-4e0c-a3d7-96d67ab4be77 req-0a49cf2f-a781-437f-98b0-a423abedde83 tempest-AttachVolumeNegativeTest-1992678294 None] attachment_update completed successfully. Sep 28 05:10:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Acquiring lock "cinder-quobyte-3804d530-65a9-4729-9835-6af8cc4a6675" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "cinder-quobyte-3804d530-65a9-4729-9835-6af8cc4a6675" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe34783-3d3f-429d-9fee-aac0e0a3dace]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:51 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:51 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:51 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.519s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:51 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675 Sep 28 05:10:51 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:51 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3804d530-65a9-4729-9835-6af8cc4a6675" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "cinder-quobyte-3804d530-65a9-4729-9835-6af8cc4a6675" released by "delete_volume" :: held 0.909s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-fc716df7-f12d-4439-9285-a2e91732a763 req-c9d57f4f-67eb-4e53-91a9-8de22245e7fc tempest-AttachVolumeNegativeTest-1992678294 None] Terminate volume connection completed successfully. Sep 28 05:10:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-fc716df7-f12d-4439-9285-a2e91732a763 req-c9d57f4f-67eb-4e53-91a9-8de22245e7fc tempest-AttachVolumeNegativeTest-1992678294 None] Deleting attachment 67c2309b-8000-4c73-a4b1-312cc411d37e. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Created reservations ['7666a0e9-df48-40f5-9ae5-9d1cccd0d15c', '964c1cfe-f60a-40fe-b20b-51189bdcd827', '55db82ad-65d3-46dd-8042-df31bf3d7710', 'a5a3f793-4a26-490a-b6d3-7b2d521df434'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:52 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:52 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:52 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.417s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Deleted volume successfully. Sep 28 05:10:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce8d4d3c-445a-4742-aa76-0011e3abeb5e tempest-VolumesActionsTest-1161518360 None] Lock "cinder-3804d530-65a9-4729-9835-6af8cc4a6675-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:54 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b18c3db1-3176-4d2a-91d7-624497c47316 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-450859217: creating Sep 28 05:10:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b18c3db1-3176-4d2a-91d7-624497c47316 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-450859217: created successfully Sep 28 05:10:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b18c3db1-3176-4d2a-91d7-624497c47316 tempest-GroupSnapshotsTest-1981901136 None] Create group completed successfully. Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (2c09dfbd-c22f-4fc8-ae68-6efe8e513879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70566c05-d0ec-46a8-8d05-0083926d0043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70566c05-d0ec-46a8-8d05-0083926d0043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555372710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125e4d65-a137-4221-99ab-a033db453585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:56Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25818824-97d4-4f45-bbdc-8865fc166226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25818824-97d4-4f45-bbdc-8865fc166226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82a2850-dc72-419e-90d1-8177997e71ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82a2850-dc72-419e-90d1-8177997e71ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125e4d65-a137-4221-99ab-a033db453585', 'volume_name': 'volume-125e4d65-a137-4221-99ab-a033db453585', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae716f-3e8d-4c28-9734-9ae3c5f99fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae716f-3e8d-4c28-9734-9ae3c5f99fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9577af91-a649-4534-8bd1-fe9229547fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Volume 125e4d65-a137-4221-99ab-a033db453585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125e4d65-a137-4221-99ab-a033db453585', 'volume_size': 1} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1555372710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125e4d65-a137-4221-99ab-a033db453585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:56Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Creating volume 125e4d65-a137-4221-99ab-a033db453585 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:10:55 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:10:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:55 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 1073741824 Sep 28 05:10:55 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:56 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 1073741824" returned: 0 in 0.673s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:56 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 Sep 28 05:10:56 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:10:56 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (705414c5-644e-4294-ae73-bd1de4152c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ed6158-5640-408e-8ccc-c4c1ff928888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585" returned: 0 in 0.301s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ed6158-5640-408e-8ccc-c4c1ff928888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781302305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=feb64b66-d515-43ae-94be-459d5e3af7f1,host='devstack@QuobyteHD#QuobyteHD',id=826f0e78-dbd5-42a1-8da4-05a5fc32d7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:57Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af06a7c5-172a-49b3-a566-2b72b53209cf),volume_type_id=af06a7c5-172a-49b3-a566-2b72b53209cf)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d030ce64-8209-474e-94a4-85dfe4d11c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d030ce64-8209-474e-94a4-85dfe4d11c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a7fc9e-11b0-4300-969e-0dab717ee96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a7fc9e-11b0-4300-969e-0dab717ee96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826f0e78-dbd5-42a1-8da4-05a5fc32d7a3', 'volume_name': 'volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5199cf5-55f5-4faa-9683-9f1338c3ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5199cf5-55f5-4faa-9683-9f1338c3ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fbeb4b-ba34-4ff4-b755-bffbc8ddaebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Volume 826f0e78-dbd5-42a1-8da4-05a5fc32d7a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3', 'volume_size': 1} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=feb64b66-d515-43ae-94be-459d5e3af7f1,created_at=2026-09-28T03:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781302305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=feb64b66-d515-43ae-94be-459d5e3af7f1,host='devstack@QuobyteHD#QuobyteHD',id=826f0e78-dbd5-42a1-8da4-05a5fc32d7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:10:57Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af06a7c5-172a-49b3-a566-2b72b53209cf),volume_type_id=af06a7c5-172a-49b3-a566-2b72b53209cf)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Creating volume 826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:10:56 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9577af91-a649-4534-8bd1-fe9229547fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125e4d65-a137-4221-99ab-a033db453585', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fffba-3961-4118-8990-14c8d22b309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:56 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 1073741824 Sep 28 05:10:56 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Volume volume-125e4d65-a137-4221-99ab-a033db453585 (125e4d65-a137-4221-99ab-a033db453585): created successfully Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fffba-3961-4118-8990-14c8d22b309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (2c09dfbd-c22f-4fc8-ae68-6efe8e513879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-70673fa8-0a34-4344-a722-b19e9e9b51af tempest-AttachVolumeTestJSON-547550533 None] Created volume successfully. Sep 28 05:10:57 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 1073741824" returned: 0 in 0.566s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:57 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:10:57 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:57 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 0.310s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fbeb4b-ba34-4ff4-b755-bffbc8ddaebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ae7b3f-4ff5-4357-88bf-4dac187c8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:10:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Volume volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 (826f0e78-dbd5-42a1-8da4-05a5fc32d7a3): created successfully Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ae7b3f-4ff5-4357-88bf-4dac187c8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:10:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (705414c5-644e-4294-ae73-bd1de4152c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:10:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5bd275bc-f8a5-4bcc-a20a-cd2145c12981 tempest-GroupSnapshotsTest-1981901136 None] Created volume successfully. Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-5878f7ea-09e3-40b1-bb04-08c11620a779-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-5878f7ea-09e3-40b1-bb04-08c11620a779-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-quobyte-5878f7ea-09e3-40b1-bb04-08c11620a779" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-5878f7ea-09e3-40b1-bb04-08c11620a779" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b060674-aed4-4e1d-9f9c-77676cadbcc9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:58 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 Sep 28 05:10:58 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] GroupSnapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: creating. Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Group snapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: creating. {{(pid=86815) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Creating offline snapshot 68fcd33e-06bd-47f9-ba6a-ad48162bd865 of volume 826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb2eed-0a4d-4516-bd09-0cdc2a6e3b0f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:58 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779" returned: 0 in 0.603s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:58 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:10:58 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:58 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779 Sep 28 05:10:58 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-0cf0991c-8689-4671-bf91-cbc56ccfddda req-5fd04d39-af77-4638-92fc-b8e40c37b55d tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:59 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:59 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 1G Sep 28 05:10:59 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:59 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5878f7ea-09e3-40b1-bb04-08c11620a779" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-5878f7ea-09e3-40b1-bb04-08c11620a779" released by "delete_volume" :: held 1.033s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Created reservations ['55e6d73a-604c-42c3-a9a1-719dbc35241d', 'b35e0426-ed16-45a8-8e1a-90c2bcea4eeb', '469768f6-9f60-4e60-af88-9b358979eb97', '5170b66e-1385-4474-95d6-2f0424555180'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:59 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:10:59 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:59 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 1G" returned: 0 in 0.483s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:59 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.276s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:10:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Deleted volume successfully. Sep 28 05:10:59 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:10:59 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4f64e3ca-8851-47f8-9ef7-a187dba8b6e4 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-5878f7ea-09e3-40b1-bb04-08c11620a779-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:10:59 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:10:59 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:10:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:10:59 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:10:59 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:00 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.267s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:00 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info Sep 28 05:11:00 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-abc7c713-7cca-43f1-a94e-7ddef7e9bc33-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-abc7c713-7cca-43f1-a94e-7ddef7e9bc33-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-quobyte-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f33e79b-ce28-443b-971d-b3af10cce959]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:00 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info" returned: 0 in 0.370s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:00 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:00 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info Sep 28 05:11:00 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:00 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 Sep 28 05:11:00 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:00 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.info" returned: 0 in 0.345s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-0cf0991c-8689-4671-bf91-cbc56ccfddda req-5fd04d39-af77-4638-92fc-b8e40c37b55d tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.910s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:01 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-0cf0991c-8689-4671-bf91-cbc56ccfddda req-5fd04d39-af77-4638-92fc-b8e40c37b55d tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:01 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33 Sep 28 05:11:01 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-0cf0991c-8689-4671-bf91-cbc56ccfddda req-5fd04d39-af77-4638-92fc-b8e40c37b55d tempest-AttachVolumeTestJSON-547550533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-125e4d65-a137-4221-99ab-a033db453585', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97272b6a-943c-4b0e-a513-446141ca10eb', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:11:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a44a3027-b2ee-4e19-807b-e1484176bc9c tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: created successfully Sep 28 05:11:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-0cf0991c-8689-4671-bf91-cbc56ccfddda req-5fd04d39-af77-4638-92fc-b8e40c37b55d tempest-AttachVolumeTestJSON-547550533 None] attachment_update completed successfully. Sep 28 05:11:01 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-abc7c713-7cca-43f1-a94e-7ddef7e9bc33" released by "delete_volume" :: held 0.776s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Created reservations ['dcda4839-7d24-4c0e-85e2-98de87a88690', '66bc04c8-dfc7-48b7-b174-08c5d94f3fa6', 'a1ccb980-75b1-4b38-baa1-d4580a831785', '4c588d3b-0dfa-494b-80c3-e8f75748783a'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:01 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:01 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:01 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Deleted volume successfully. Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-0293b459-57c2-4882-9926-c3600941c2d3-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-0293b459-57c2-4882-9926-c3600941c2d3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3263034f-e70d-4d1d-8b4d-951fabeab105 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-abc7c713-7cca-43f1-a94e-7ddef7e9bc33-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "cinder-quobyte-0293b459-57c2-4882-9926-c3600941c2d3" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-0293b459-57c2-4882-9926-c3600941c2d3" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[865700c6-4533-4d61-aa7e-2b76cc6c7e01]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:02 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 Sep 28 05:11:02 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:02 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3" returned: 0 in 0.504s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Creating volume 0e940a6a-b7dc-42b3-94e7-017cb8494ec7 from snapshot 68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:02 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3 Sep 28 05:11:02 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] snapshot: 68fcd33e-06bd-47f9-ba6a-ad48162bd865, volume: 0e940a6a-b7dc-42b3-94e7-017cb8494ec7, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5649ed-fb6d-4ed9-a0f1-ca08359068b4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:02 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0293b459-57c2-4882-9926-c3600941c2d3" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:02 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:11:02 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-quobyte-0293b459-57c2-4882-9926-c3600941c2d3" released by "delete_volume" :: held 0.876s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Created reservations ['f9f71074-7219-4554-9f7c-6ad0a962a783', '7055e941-452a-477e-8eb9-398c4be2e088', '5c6828e2-231c-436a-98c4-937cda3a29c1', 'ea196506-e8dd-4689-ba9a-79d433df8c63'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:03 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:03 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:03 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.639s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dfc9e3-50a5-4395-a822-b2523f5fef14]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:03 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.386s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Deleted volume successfully. Sep 28 05:11:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ce3735d1-45ce-4174-b6b5-f06ad8e294e6 tempest-AttachVolumeNegativeTest-1992678294 None] Lock "cinder-0293b459-57c2-4882-9926-c3600941c2d3-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:03 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:11:03 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:04 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 0.646s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:11:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:11:04 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:11:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:04 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 Sep 28 05:11:04 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:12 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" returned: 0 in 8.682s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:12 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:11:12 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Converted 1024.00 MB image at 117.91 MB/s Sep 28 05:11:12 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:12 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 Sep 28 05:11:12 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:13 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=68,cinder:UPDATE=78,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:11:13 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" returned: 0 in 0.524s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" released by "_copy_volume_from_snapshot" :: held 10.655s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" released by "_create_volume_from_snapshot" :: held 10.776s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.811s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-03a21858-b2fd-4864-af87-20d732fd11f5 tempest-GroupSnapshotsTest-1981901136 None] Create group from source-snapshot-4581bf98-1eb3-4eb6-9d16-9f1999d53d2b completed successfully. Sep 28 05:11:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e8eb9c-7d93-422b-a5ef-7d8fbb7b567a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:14 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 Sep 28 05:11:14 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:15 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" returned: 0 in 0.655s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:15 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7 Sep 28 05:11:15 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:15 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" returned: 0 in 0.418s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-0e940a6a-b7dc-42b3-94e7-017cb8494ec7" released by "delete_volume" :: held 1.153s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['fcdb12c3-4aae-495a-98d0-7c4c1050218a'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:15 devstack cinder-volume[86815]: WARNING cinder.quota [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1999407737 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1999407737, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:15 devstack cinder-volume[86815]: WARNING cinder.quota [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1999407737 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1999407737, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['d5435969-f97a-4a65-8ac7-ddcba5088d51', 'cb92d84e-e5f8-4b61-8d88-15e7fe9d9254', '59b84261-a68d-40a8-b8f0-78627514ab20', '313fe508-d585-4eaa-9abb-2190813f956d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:16 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:16 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:16 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.428s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:16 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d279efe5-e87a-4f5f-9507-88cffb3e97d7 tempest-GroupSnapshotsTest-1981901136 None] Delete group completed successfully. Sep 28 05:11:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: deleting Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: deleting {{(pid=86815) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Deleting offline snapshot 68fcd33e-06bd-47f9-ba6a-ad48162bd865 of volume 826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] snapshot_file for this snap is: volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88aad5-802e-4764-9d2d-3641205e7a6c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:17 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:11:17 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:17 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.573s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:11:18 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d14051-42a1-41ba-a9b4-3e766052d5c3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:18 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:11:18 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:19 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 1.205s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:19 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:11:19 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:20 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.777s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:20 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865 Sep 28 05:11:20 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:20 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3.68fcd33e-06bd-47f9-ba6a-ad48162bd865" returned: 0 in 0.422s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-68fcd33e-06bd-47f9-ba6a-ad48162bd865" released by "_delete_snapshot" :: held 3.309s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" released by "delete_snapshot" :: held 3.356s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:20 devstack cinder-volume[86815]: WARNING cinder.quota [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1999407737 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1999407737, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:20 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['109906a0-6cec-45c4-9a11-9d0347eb32c3', '180bb777-79cb-4a41-b489-23d6afb21beb', '9cd51176-025b-441f-9b4f-5fad9b3c825d', 'd0a7a572-2dd0-426a-9838-31397e63bc4e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-74796427-8956-4416-a4dc-06a0421e7daf tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 4581bf98-1eb3-4eb6-9d16-9f1999d53d2b: deleted successfully Sep 28 05:11:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1328d-4d4a-4194-917c-49493800161f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:22 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:11:22 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:23 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 0.662s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:23 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3 Sep 28 05:11:23 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:23 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-826f0e78-dbd5-42a1-8da4-05a5fc32d7a3" released by "delete_volume" :: held 1.176s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['d87f6fa9-a0cb-4548-b204-f0d2b31b44b9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:23 devstack cinder-volume[86815]: WARNING cinder.db.api [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1999407737'] Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['c9e63d96-aa7a-409a-bb11-07372c00ca13', '50292b49-5124-4e0c-84db-6453dc17834a', 'ace8b32a-e292-41b3-9883-df72cc8e885a', '0f9b602f-bec9-4b9f-aaf4-5de944dba455'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:23 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:23 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:24 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.406s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:24 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-85f01eb4-46bb-4857-bae4-c2b58ca8dda8 tempest-GroupSnapshotsTest-1981901136 None] Delete group completed successfully. Sep 28 05:11:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e3c4be3e-a3d8-4240-9c92-2afe991fe021 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-417597753: creating Sep 28 05:11:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e3c4be3e-a3d8-4240-9c92-2afe991fe021 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-417597753: created successfully Sep 28 05:11:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e3c4be3e-a3d8-4240-9c92-2afe991fe021 tempest-GroupSnapshotsTest-1981901136 None] Create group completed successfully. Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (6262bb90-1a2c-4ac4-9652-04d924bcc953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0041aa-5419-4b4c-b383-71c594734f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0041aa-5419-4b4c-b383-71c594734f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229774882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,host='devstack@QuobyteHD#QuobyteHD',id=738e444f-d258-48c8-9040-ae52a5c1f323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:27Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03168fce-86e4-41da-9685-d5778940ae06),volume_type_id=03168fce-86e4-41da-9685-d5778940ae06)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28df0f63-d1e8-477f-bd78-b7ed2e52eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28df0f63-d1e8-477f-bd78-b7ed2e52eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5c5f5a-7b73-4e75-a47b-574f3a347f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5c5f5a-7b73-4e75-a47b-574f3a347f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738e444f-d258-48c8-9040-ae52a5c1f323', 'volume_name': 'volume-738e444f-d258-48c8-9040-ae52a5c1f323', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82b7129-4dbc-417f-8a8e-32c76757ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82b7129-4dbc-417f-8a8e-32c76757ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30078a4d-cac0-4cf0-8436-ee3ce0ad7d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Volume 738e444f-d258-48c8-9040-ae52a5c1f323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738e444f-d258-48c8-9040-ae52a5c1f323', 'volume_size': 1} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,created_at=2026-09-28T03:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229774882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,host='devstack@QuobyteHD#QuobyteHD',id=738e444f-d258-48c8-9040-ae52a5c1f323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:27Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03168fce-86e4-41da-9685-d5778940ae06),volume_type_id=03168fce-86e4-41da-9685-d5778940ae06)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Creating volume 738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:11:27 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:11:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:27 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 1073741824 Sep 28 05:11:27 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:28 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 1073741824" returned: 0 in 0.639s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=98,cinder:UPDATE=106,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:28 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 Sep 28 05:11:28 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:28 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323" returned: 0 in 0.306s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30078a4d-cac0-4cf0-8436-ee3ce0ad7d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738e444f-d258-48c8-9040-ae52a5c1f323', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fef4e0c-2ebb-4c9d-9cb7-daf1b0b32abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:28 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Volume volume-738e444f-d258-48c8-9040-ae52a5c1f323 (738e444f-d258-48c8-9040-ae52a5c1f323): created successfully Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fef4e0c-2ebb-4c9d-9cb7-daf1b0b32abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (6262bb90-1a2c-4ac4-9652-04d924bcc953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-00b2a3f1-a6bf-4ce8-b8be-8466c8e89bca tempest-GroupSnapshotsTest-1981901136 None] Created volume successfully. Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:29 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:29 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:29 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.369s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:11:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (2445843a-b65e-4a2a-8f5f-59c0fe13021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca9c79d-f7e5-4d29-b20f-fc824c4a3f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca9c79d-f7e5-4d29-b20f-fc824c4a3f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1277996143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,host='devstack@QuobyteHD#QuobyteHD',id=7f8b8ad6-71ad-4629-9abe-778eda9e7018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:31Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03168fce-86e4-41da-9685-d5778940ae06),volume_type_id=03168fce-86e4-41da-9685-d5778940ae06)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a933874d-9c0d-4385-b629-016dcbcb6b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a933874d-9c0d-4385-b629-016dcbcb6b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95734b09-1e5e-444d-b8c1-6fded8c201e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95734b09-1e5e-444d-b8c1-6fded8c201e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8b8ad6-71ad-4629-9abe-778eda9e7018', 'volume_name': 'volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5fb8e7-0236-48e1-9108-08b9566c5648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5fb8e7-0236-48e1-9108-08b9566c5648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079f781b-077d-4b21-9f54-9853396ee4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:31 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Volume 7f8b8ad6-71ad-4629-9abe-778eda9e7018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018', 'volume_size': 1} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,created_at=2026-09-28T03:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1277996143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bda4f071-3d91-4c8a-a37e-910a1740a5ba,host='devstack@QuobyteHD#QuobyteHD',id=7f8b8ad6-71ad-4629-9abe-778eda9e7018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:31Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03168fce-86e4-41da-9685-d5778940ae06),volume_type_id=03168fce-86e4-41da-9685-d5778940ae06)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Creating volume 7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:11:31 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:11:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:31 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 1073741824 Sep 28 05:11:31 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:32 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 1073741824" returned: 0 in 0.550s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:32 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 Sep 28 05:11:32 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:32 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018" returned: 0 in 0.316s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079f781b-077d-4b21-9f54-9853396ee4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d6ac99-bdc5-431d-bb88-241e1001d601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Volume volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 (7f8b8ad6-71ad-4629-9abe-778eda9e7018): created successfully Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d6ac99-bdc5-431d-bb88-241e1001d601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (2445843a-b65e-4a2a-8f5f-59c0fe13021a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d6e74425-6288-4270-9e96-4b10c60fb527 tempest-GroupSnapshotsTest-1981901136 None] Created volume successfully. Sep 28 05:11:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4522c6cd-82f7-4f99-a0c5-ca58158f86ab tempest-GroupSnapshotsTest-1981901136 None] Update group completed successfully. Sep 28 05:11:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-12ec8333-e074-481e-b344-c6aa7f59d00d tempest-GroupSnapshotsTest-1981901136 None] Update group completed successfully. Sep 28 05:11:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-62a0bd48-00a4-46ee-9560-69a48b34aedc tempest-GroupSnapshotsTest-1981901136 None] Update group completed successfully. Sep 28 05:11:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5f3b2588-3ffd-430c-a0b0-05d28c2dfa92 tempest-GroupSnapshotsTest-1981901136 None] Update group completed successfully. Sep 28 05:11:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] GroupSnapshot cdd8245a-b450-445f-95e3-30a45465276e: creating. Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Group snapshot cdd8245a-b450-445f-95e3-30a45465276e: creating. {{(pid=86815) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Creating offline snapshot afe8ee30-1acb-43ec-965d-34ba8362534d of volume 738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9073eb6e-1091-4516-a4fb-e3838d0ea693]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:38 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 Sep 28 05:11:38 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:39 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323" returned: 0 in 0.557s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:39 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d 1G Sep 28 05:11:39 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:39 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d 1G" returned: 0 in 0.558s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738e444f-d258-48c8-9040-ae52a5c1f323 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:39 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738e444f-d258-48c8-9040-ae52a5c1f323 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d Sep 28 05:11:39 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:40 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738e444f-d258-48c8-9040-ae52a5c1f323 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d" returned: 0 in 0.342s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:40 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:40 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d Sep 28 05:11:40 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:40 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d" returned: 0 in 0.275s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:40 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info Sep 28 05:11:40 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:40 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info" returned: 0 in 0.277s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:40 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:40 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info Sep 28 05:11:40 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:41 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.info" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Creating offline snapshot bd144cd7-b5e5-463b-a3ff-78e4bca61968 of volume 7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e977fcad-7733-4721-ba94-dabe90562917]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:41 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 Sep 28 05:11:41 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:41 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018" returned: 0 in 0.416s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:41 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 1G Sep 28 05:11:41 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:42 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 1G" returned: 0 in 0.597s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:42 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 Sep 28 05:11:42 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:42 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968" returned: 0 in 0.521s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:42 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:42 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 Sep 28 05:11:42 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-d2d7152c-99ec-448f-95f0-0f3e39680209 req-fe8427cd-fb85-4f07-9a6e-13ce670de695 tempest-AttachVolumeTestJSON-547550533 None] Terminate volume connection completed successfully. Sep 28 05:11:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-d2d7152c-99ec-448f-95f0-0f3e39680209 req-fe8427cd-fb85-4f07-9a6e-13ce670de695 tempest-AttachVolumeTestJSON-547550533 None] Deleting attachment 97272b6a-943c-4b0e-a513-446141ca10eb. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:11:43 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:43 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info Sep 28 05:11:43 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:43 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info" returned: 0 in 0.434s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:43 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:11:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:43 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info Sep 28 05:11:43 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:44 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.info" returned: 0 in 0.498s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-02abd90f-969a-4aae-8e04-e76f0f95f673 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot cdd8245a-b450-445f-95e3-30a45465276e: created successfully Sep 28 05:11:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot cdd8245a-b450-445f-95e3-30a45465276e: deleting Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot cdd8245a-b450-445f-95e3-30a45465276e: deleting {{(pid=86815) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-afe8ee30-1acb-43ec-965d-34ba8362534d" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-afe8ee30-1acb-43ec-965d-34ba8362534d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Deleting offline snapshot afe8ee30-1acb-43ec-965d-34ba8362534d of volume 738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] snapshot_file for this snap is: volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74322d6-af9a-4c14-ab8f-dc49bccb7e70]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:46 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d Sep 28 05:11:46 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:46 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d" returned: 0 in 0.807s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738e444f-d258-48c8-9040-ae52a5c1f323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:11:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d5338-24ad-4cbd-a577-1386a148856d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:46 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 Sep 28 05:11:46 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:47 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323" returned: 0 in 0.752s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:47 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d Sep 28 05:11:47 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:47 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d" returned: 0 in 0.568s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:48 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d Sep 28 05:11:48 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:48 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323.afe8ee30-1acb-43ec-965d-34ba8362534d" returned: 0 in 0.530s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-afe8ee30-1acb-43ec-965d-34ba8362534d" released by "_delete_snapshot" :: held 2.864s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" released by "delete_snapshot" :: held 2.907s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-bd144cd7-b5e5-463b-a3ff-78e4bca61968" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-bd144cd7-b5e5-463b-a3ff-78e4bca61968" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Deleting offline snapshot bd144cd7-b5e5-463b-a3ff-78e4bca61968 of volume 7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] snapshot_file for this snap is: volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdab9da-796b-4e48-8f5c-a6f0b71f669d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:48 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 Sep 28 05:11:48 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:49 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968" returned: 0 in 0.740s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:11:49 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80a6d34-9d74-41dc-93da-581820220a7f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:49 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 Sep 28 05:11:49 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:50 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018" returned: 0 in 1.191s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:50 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 Sep 28 05:11:50 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:51 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968" returned: 0 in 0.905s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:51 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968 Sep 28 05:11:51 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:52 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018.bd144cd7-b5e5-463b-a3ff-78e4bca61968" returned: 0 in 0.436s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-bd144cd7-b5e5-463b-a3ff-78e4bca61968" released by "_delete_snapshot" :: held 3.537s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" released by "delete_snapshot" :: held 3.588s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:52 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-307358928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-307358928, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:52 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-307358928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-307358928, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['22b1a118-824d-4652-ad1d-1be5f31e92df', 'f4bae13d-59bb-4b78-af04-dabdf6b87b75', 'd59b3f14-8b95-4d44-bdfc-fb4f403975b0', '43174931-3db0-475b-8d30-a5b5d1ae5f1c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['38e2b25b-e9db-4286-9dfc-dadcee0e7530', '76fa7d49-16ab-4d93-b22c-f1c0c66252e5', '2eb61f01-8a56-4db7-85f4-17fd2ff58283', 'be2c874f-0b4d-40a3-b278-bda5adae3f39'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4fa4920a-6b0f-4d0c-a4fd-20a3f7047201 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot cdd8245a-b450-445f-95e3-30a45465276e: deleted successfully Sep 28 05:11:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" acquired by "delete_volume" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:54 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6062e7-ea21-4587-ac21-37a141adeb2e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:54 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 Sep 28 05:11:54 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:55 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323" returned: 0 in 0.571s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:55 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323 Sep 28 05:11:55 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:55 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-738e444f-d258-48c8-9040-ae52a5c1f323" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-738e444f-d258-48c8-9040-ae52a5c1f323" released by "delete_volume" :: held 1.187s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf33187-c288-4575-913f-ccd3130afb62]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:55 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 Sep 28 05:11:55 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:56 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018" returned: 0 in 0.646s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:11:56 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018 Sep 28 05:11:56 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Flow 'volume_create_manager' (6ccbc8d5-314d-403e-8d3d-d8386f72442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b859a189-46cb-4427-a58a-7a0df2456e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b859a189-46cb-4427-a58a-7a0df2456e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1298746452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159c90bd-fa32-4d64-b231-b9a427f70e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63dbdb7548446e9a4da6ea707305b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:56Z,use_quota=True,user_id='db926a03355c4af3872637b827056ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9793d8b-c4a8-4443-b9c6-5d63f5308d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9793d8b-c4a8-4443-b9c6-5d63f5308d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea9bb23-b37f-47ef-bbaf-bf669d2efdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea9bb23-b37f-47ef-bbaf-bf669d2efdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159c90bd-fa32-4d64-b231-b9a427f70e14', 'volume_name': 'volume-159c90bd-fa32-4d64-b231-b9a427f70e14', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5106d-4b7c-46b9-9293-edac6e09e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5106d-4b7c-46b9-9293-edac6e09e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208cbf42-8b33-407d-b1f3-9470243df342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Volume 159c90bd-fa32-4d64-b231-b9a427f70e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159c90bd-fa32-4d64-b231-b9a427f70e14', 'volume_size': 1} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1298746452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159c90bd-fa32-4d64-b231-b9a427f70e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63dbdb7548446e9a4da6ea707305b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:56Z,use_quota=True,user_id='db926a03355c4af3872637b827056ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Creating volume 159c90bd-fa32-4d64-b231-b9a427f70e14 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:11:56 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:11:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:56 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 1073741824 Sep 28 05:11:56 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:57 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7f8b8ad6-71ad-4629-9abe-778eda9e7018" returned: 0 in 0.697s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-7f8b8ad6-71ad-4629-9abe-778eda9e7018" released by "delete_volume" :: held 1.462s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Flow 'volume_create_manager' (21d01c5a-fae6-4568-80ff-395e4db6023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1fe3c-a54f-4159-89e2-dafc5bf0911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:57 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 1073741824" returned: 0 in 0.660s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1fe3c-a54f-4159-89e2-dafc5bf0911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1427413114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61429f04-8bda-4796-8570-1662f7dc3483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0d0f592bc4521864b0bae3d290313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:57Z,use_quota=True,user_id='576abce3100d4e1bb0688c77886ea06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d42fed-567c-4f5e-822b-9273a8803ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d42fed-567c-4f5e-822b-9273a8803ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ee0896-90c6-4a49-ad51-75fef4af4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['581d4bf1-62cb-4b7d-a4d2-89b91d5dd046'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:57 devstack cinder-volume[86815]: WARNING cinder.quota [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-307358928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-307358928, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['610477c9-2927-40ad-819b-3c1e58e38690', '6080b011-42a7-4f3d-bfeb-d98056a4c4ce', '338d45be-4c64-4dca-99ad-48756b064636', '0338a971-fec7-42e3-87f0-86c3f76f2c66'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:57 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 Sep 28 05:11:57 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['5c928a4f-0423-42b1-b84c-e0637fed9091', '3987a98f-6326-4cc3-8635-c0475f2cdf95', '0f4eae91-7fb1-44b6-976a-6e4feea84d22', '57d3a862-f642-4c3d-ad86-68c15b3780ef'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ee0896-90c6-4a49-ad51-75fef4af4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61429f04-8bda-4796-8570-1662f7dc3483', 'volume_name': 'volume-61429f04-8bda-4796-8570-1662f7dc3483', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e56409e-c3a4-4ae0-844f-ce2486ef1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e56409e-c3a4-4ae0-844f-ce2486ef1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d501e110-2e7f-43bf-9c81-f75c5d743804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Volume 61429f04-8bda-4796-8570-1662f7dc3483: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61429f04-8bda-4796-8570-1662f7dc3483', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Trying to clone 61429f04-8bda-4796-8570-1662f7dc3483 from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:58 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14" returned: 0 in 0.666s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:58 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:11:58 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208cbf42-8b33-407d-b1f3-9470243df342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159c90bd-fa32-4d64-b231-b9a427f70e14', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe36a8-bef1-421a-a3aa-5d2a18fdfccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:11:58 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Volume volume-159c90bd-fa32-4d64-b231-b9a427f70e14 (159c90bd-fa32-4d64-b231-b9a427f70e14): created successfully Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe36a8-bef1-421a-a3aa-5d2a18fdfccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Flow 'volume_create_manager' (6ccbc8d5-314d-403e-8d3d-d8386f72442b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:11:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-28288bcd-2fa2-4fa3-9104-b2f72a8b5b13 tempest-TestMinimumBasicScenario-940597612 None] Created volume successfully. Sep 28 05:11:58 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.461s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:11:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bda4857f-ee63-49a2-b8f1-5f75b931b594 tempest-GroupSnapshotsTest-1981901136 None] Delete group completed successfully. Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:11:58 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Image download 20.69 MB at 20.69 MB/s Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3ce55f-7d3d-4fc5-a9fe-96119d6582fa]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:58 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD Sep 28 05:11:58 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:59 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b is fetched for user 576abce3100d4e1bb0688c77886ea06a. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fcd224-1d21-475d-89f0-f973bf728c88]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:59 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD Sep 28 05:11:59 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:11:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-36baeffe-52af-41b2-872b-f4e8a2d52ff0 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-1060928273: creating Sep 28 05:11:59 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1427413114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61429f04-8bda-4796-8570-1662f7dc3483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d0d0f592bc4521864b0bae3d290313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:11:57Z,use_quota=True,user_id='576abce3100d4e1bb0688c77886ea06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Creating volume 61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:11:59 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:11:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:11:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-36baeffe-52af-41b2-872b-f4e8a2d52ff0 tempest-GroupSnapshotsTest-1981901136 None] Group tempest-GroupSnapshotsTest-Group-1060928273: created successfully Sep 28 05:12:00 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1073741824 Sep 28 05:12:00 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-36baeffe-52af-41b2-872b-f4e8a2d52ff0 tempest-GroupSnapshotsTest-1981901136 None] Create group completed successfully. Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-04fc68f2-1b64-4e6f-bdbe-028835a75dfa req-51bd5e28-9c3b-4845-aa10-5da52b9bbc42 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:00 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1073741824" returned: 0 in 0.552s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:00 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 Sep 28 05:12:00 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:00 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483" returned: 0 in 0.378s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-04fc68f2-1b64-4e6f-bdbe-028835a75dfa req-51bd5e28-9c3b-4845-aa10-5da52b9bbc42 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.530s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-04fc68f2-1b64-4e6f-bdbe-028835a75dfa req-51bd5e28-9c3b-4845-aa10-5da52b9bbc42 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Attempting download of 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume 61429f04-8bda-4796-8570-1662f7dc3483. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-04fc68f2-1b64-4e6f-bdbe-028835a75dfa req-51bd5e28-9c3b-4845-aa10-5da52b9bbc42 tempest-TestMinimumBasicScenario-940597612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-159c90bd-fa32-4d64-b231-b9a427f70e14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '358929ec-3fe5-4fba-960a-14fd5b7736f6', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[359471de-d49d-4507-8f8c-6a126012f516]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-04fc68f2-1b64-4e6f-bdbe-028835a75dfa req-51bd5e28-9c3b-4845-aa10-5da52b9bbc42 tempest-TestMinimumBasicScenario-940597612 None] attachment_update completed successfully. Sep 28 05:12:01 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2 Sep 28 05:12:01 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (caaa78ad-1fe6-40d2-9e7c-acf3a3dd3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf83af-fc35-4a95-bcf1-a995bf1311bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf83af-fc35-4a95-bcf1-a995bf1311bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-329865224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13e376ef-1dbf-4856-a2ff-a55aa45fa068,host='devstack@QuobyteHD#QuobyteHD',id=e123720f-de16-4466-883a-e0ab36fbe4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:02Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae237faa-e651-4dc7-9e14-48cfaaeccd6b),volume_type_id=ae237faa-e651-4dc7-9e14-48cfaaeccd6b)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6c988-4b9e-4be0-9943-ed1b3b1ecba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6c988-4b9e-4be0-9943-ed1b3b1ecba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd379a9-1acc-4a54-a68b-153bcccd057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd379a9-1acc-4a54-a68b-153bcccd057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e123720f-de16-4466-883a-e0ab36fbe4ed', 'volume_name': 'volume-e123720f-de16-4466-883a-e0ab36fbe4ed', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:02 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820a0ea4-8a9b-47b3-b597-70b329787f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820a0ea4-8a9b-47b3-b597-70b329787f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b8256-acb7-4bb4-aa16-28608c67a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:02 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Volume e123720f-de16-4466-883a-e0ab36fbe4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e123720f-de16-4466-883a-e0ab36fbe4ed', 'volume_size': 1} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13e376ef-1dbf-4856-a2ff-a55aa45fa068,created_at=2026-09-28T03:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-329865224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13e376ef-1dbf-4856-a2ff-a55aa45fa068,host='devstack@QuobyteHD#QuobyteHD',id=e123720f-de16-4466-883a-e0ab36fbe4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943dd828543847599e19a9b455bb084e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:02Z,use_quota=True,user_id='3ab586fd65314b749137dfe63a98e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae237faa-e651-4dc7-9e14-48cfaaeccd6b),volume_type_id=ae237faa-e651-4dc7-9e14-48cfaaeccd6b)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Creating volume e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:02 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2" returned: 0 in 0.937s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:02 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed 1073741824 Sep 28 05:12:02 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:02 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2 Sep 28 05:12:02 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:02 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2" returned: 1 in 0.527s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_u5wqesb2' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8bc92-3a91-4d2b-b4ef-99b3ff6ec858]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:02 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed 1073741824" returned: 0 in 0.735s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:02 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD Sep 28 05:12:02 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:03 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed Sep 28 05:12:03 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:03 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] 1cf8d7db-9851-461c-94d0-a979c9e2e98b was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:03 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 Sep 28 05:12:03 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:03 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed" returned: 0 in 0.591s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9b8256-acb7-4bb4-aa16-28608c67a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e123720f-de16-4466-883a-e0ab36fbe4ed', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903abf8e-50ed-412e-8985-20b45b76025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Volume volume-e123720f-de16-4466-883a-e0ab36fbe4ed (e123720f-de16-4466-883a-e0ab36fbe4ed): created successfully Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903abf8e-50ed-412e-8985-20b45b76025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Flow 'volume_create_manager' (caaa78ad-1fe6-40d2-9e7c-acf3a3dd3402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a517afb1-adfc-45e0-9585-4cd108417674 tempest-GroupSnapshotsTest-1981901136 None] Created volume successfully. Sep 28 05:12:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] GroupSnapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: creating. Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Group snapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: creating. {{(pid=86815) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Creating offline snapshot 2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 of volume e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f1f51-c2d8-4e13-a180-886148684acc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:05 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed Sep 28 05:12:05 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:06 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483" returned: 0 in 2.711s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_0uznzqpedevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:12:06 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Converted 112.00 MB image at 41.23 MB/s Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:06 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed" returned: 0 in 0.648s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:06 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1G Sep 28 05:12:06 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:06 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 1G Sep 28 05:12:06 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:06 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 1G" returned: 0 in 0.655s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Downloaded image 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume 61429f04-8bda-4796-8570-1662f7dc3483 successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b for user 576abce3100d4e1bb0688c77886ea06a is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Marking volume 61429f04-8bda-4796-8570-1662f7dc3483 as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Copying metadata from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b to 61429f04-8bda-4796-8570-1662f7dc3483. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Creating volume glance metadata for volume 61429f04-8bda-4796-8570-1662f7dc3483 backed by image 1cf8d7db-9851-461c-94d0-a979c9e2e98b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:12:06 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 1G" returned: 0 in 0.712s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e123720f-de16-4466-883a-e0ab36fbe4ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:06 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e123720f-de16-4466-883a-e0ab36fbe4ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 Sep 28 05:12:06 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d501e110-2e7f-43bf-9c81-f75c5d743804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61429f04-8bda-4796-8570-1662f7dc3483', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d78642-1199-45fc-8580-5e01e25f2e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Volume volume-61429f04-8bda-4796-8570-1662f7dc3483 (61429f04-8bda-4796-8570-1662f7dc3483): created successfully Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d78642-1199-45fc-8580-5e01e25f2e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Flow 'volume_create_manager' (21d01c5a-fae6-4568-80ff-395e4db6023c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-15c95990-5cd2-4927-b8bc-75cba44097b6 tempest-VolumesImageMetadata-1331676916 None] Created volume successfully. Sep 28 05:12:07 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e123720f-de16-4466-883a-e0ab36fbe4ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:07 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:12:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:07 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 Sep 28 05:12:07 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:07 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:07 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info Sep 28 05:12:07 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:08 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:08 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:08 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info Sep 28 05:12:08 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Acquiring lock "cinder-61429f04-8bda-4796-8570-1662f7dc3483-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "cinder-61429f04-8bda-4796-8570-1662f7dc3483-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:08 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.info" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Acquiring lock "cinder-quobyte-61429f04-8bda-4796-8570-1662f7dc3483" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "cinder-quobyte-61429f04-8bda-4796-8570-1662f7dc3483" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98287885-2c04-4c5f-9f0f-b2b64daf603b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4a67e0f1-9dc1-4122-a324-059bb5e4c934 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: created successfully Sep 28 05:12:08 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 Sep 28 05:12:08 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: deleting Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: deleting {{(pid=86815) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:08 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Deleting offline snapshot 2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 of volume e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] snapshot_file for this snap is: volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483" returned: 0 in 0.543s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[14427787-1952-4efa-b3d6-9259569c45b4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:09 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483 Sep 28 05:12:09 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:09 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 Sep 28 05:12:09 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:09 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-61429f04-8bda-4796-8570-1662f7dc3483" returned: 0 in 0.290s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "cinder-quobyte-61429f04-8bda-4796-8570-1662f7dc3483" released by "delete_volume" :: held 0.901s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Created reservations ['bf042202-0eaa-4a7d-9b13-ce147ba34046', '7dce5c64-e406-4f6e-9f4b-96e837fdf741', '7cb9de2c-cf92-463a-bb24-5e426e17df1b', 'a9b086b2-3d92-45f9-9cad-6534599b051d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:09 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" returned: 0 in 0.465s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e123720f-de16-4466-883a-e0ab36fbe4ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:12:09 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:09 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdeb92e-af2c-4dce-9393-3ae680bffc5f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:09 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed Sep 28 05:12:09 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:09 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Deleted volume successfully. Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ecb592af-7e02-4283-922c-4c84d641d98f tempest-VolumesImageMetadata-1331676916 None] Lock "cinder-61429f04-8bda-4796-8570-1662f7dc3483-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:09 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed" returned: 0 in 0.431s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:10 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 Sep 28 05:12:10 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:10 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" returned: 0 in 0.374s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:10 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27 Sep 28 05:12:10 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:10 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed.2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" returned: 0 in 0.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-2ef4a6d4-50d6-4d33-b8ee-ca6f403c0b27" released by "_delete_snapshot" :: held 1.682s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" released by "delete_snapshot" :: held 1.708s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:10 devstack cinder-volume[86815]: WARNING cinder.quota [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-283453496 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-283453496, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:10 devstack cinder-volume[86815]: WARNING cinder.quota [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-283453496 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-283453496, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:10 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['b2e45942-ac65-4d3b-a7f6-b717639b0597', 'c8d6dd10-491a-4e1e-abc7-2f20e2f3c70c', '1c391d13-a739-4915-8b59-9635632ed00a', '42542622-7274-4ef8-b1cf-5f1e3ecc8122'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1b3c05a5-5816-4e60-869c-4a5b46a78125 tempest-GroupSnapshotsTest-1981901136 None] group_snapshot 71f39645-685d-4edf-934e-6d6fd0cf44ed: deleted successfully Sep 28 05:12:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:11 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45066e-4ae2-410c-8d3a-bfb44cb76499]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:11 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed Sep 28 05:12:11 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:12 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed" returned: 0 in 0.429s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:12 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed Sep 28 05:12:12 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:12 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e123720f-de16-4466-883a-e0ab36fbe4ed" returned: 0 in 0.272s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Lock "cinder-quobyte-e123720f-de16-4466-883a-e0ab36fbe4ed" released by "delete_volume" :: held 0.782s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['de1a2cf4-622d-4c27-841a-ca6d9c124ce6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:12 devstack cinder-volume[86815]: WARNING cinder.quota [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-283453496 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-283453496, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Created reservations ['2416df6f-810f-4a0d-926a-b589552305df', 'f96544d0-6c22-450f-9e4b-5558a5832ac5', '6797fa5d-e189-4431-8d73-c490888a28e8', 'fb6a707e-fa1f-47ab-b920-4f55885f8b67'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:12 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:12 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:12 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:12 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-58bb4f53-c392-43f1-80ad-12d351437800 tempest-GroupSnapshotsTest-1981901136 None] Delete group completed successfully. Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Flow 'volume_create_manager' (6bfd7312-3dc0-4851-bc43-05bc104ed622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c93027a-b75c-4e99-b9b1-acd175145b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=123,cinder:INSERT=34,cinder:UPDATE=112,cinder:DELETE=4 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c93027a-b75c-4e99-b9b1-acd175145b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1677529239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9de651-6c63-45df-a68b-9161ccedf5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ff8b827ae24e5796dfc654dbc7779e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:15Z,use_quota=True,user_id='e5a71dbc463a42cf9afa442fa8595258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cfcd62-a42e-4c7b-9e62-9728307ad395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cfcd62-a42e-4c7b-9e62-9728307ad395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0497157a-e620-4bb8-a77f-0fc359b8d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0497157a-e620-4bb8-a77f-0fc359b8d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9de651-6c63-45df-a68b-9161ccedf5cd', 'volume_name': 'volume-cd9de651-6c63-45df-a68b-9161ccedf5cd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141dca99-97e3-4264-a4c4-c5e48ee76513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141dca99-97e3-4264-a4c4-c5e48ee76513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82f1e84-2e62-4630-8d3c-0fe24348daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Volume cd9de651-6c63-45df-a68b-9161ccedf5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9de651-6c63-45df-a68b-9161ccedf5cd', 'volume_size': 1} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1677529239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9de651-6c63-45df-a68b-9161ccedf5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ff8b827ae24e5796dfc654dbc7779e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:15Z,use_quota=True,user_id='e5a71dbc463a42cf9afa442fa8595258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Creating volume cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:15 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:15 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd 1073741824 Sep 28 05:12:15 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:15 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd 1073741824" returned: 0 in 0.601s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:15 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd Sep 28 05:12:15 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:16 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd" returned: 0 in 0.313s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82f1e84-2e62-4630-8d3c-0fe24348daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9de651-6c63-45df-a68b-9161ccedf5cd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6e853f-83da-459b-bb76-56477feeb2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:16 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Volume volume-cd9de651-6c63-45df-a68b-9161ccedf5cd (cd9de651-6c63-45df-a68b-9161ccedf5cd): created successfully Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6e853f-83da-459b-bb76-56477feeb2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Flow 'volume_create_manager' (6bfd7312-3dc0-4851-bc43-05bc104ed622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-88927b35-bf33-4109-bf76-bd7bc6180dc8 tempest-SnapshotMetadataTestJSON-2027272897 None] Created volume successfully. Sep 28 05:12:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Creating offline snapshot 2527e037-c96b-4300-a3c9-04dc4100bc16 of volume cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:12:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe49750-4e9d-48f5-92c0-0cecf27550b2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:17 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd Sep 28 05:12:17 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:18 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd" returned: 0 in 0.406s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:18 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 1G Sep 28 05:12:18 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:18 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 1G" returned: 0 in 0.448s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9de651-6c63-45df-a68b-9161ccedf5cd -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:18 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9de651-6c63-45df-a68b-9161ccedf5cd -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 Sep 28 05:12:18 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:18 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9de651-6c63-45df-a68b-9161ccedf5cd -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16" returned: 0 in 0.313s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:18 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 is being set with open permissions: ugo+rw Sep 28 05:12:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:18 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 Sep 28 05:12:18 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:19 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:19 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info Sep 28 05:12:19 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:19 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info" returned: 0 in 0.267s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:19 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info is being set with open permissions: ugo+rw Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:19 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info Sep 28 05:12:19 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:19 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.info" returned: 0 in 0.279s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6aeffdb1-4094-4e5e-9ada-32acaf65f3ac tempest-SnapshotMetadataTestJSON-2027272897 None] Create snapshot completed successfully Sep 28 05:12:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dcf8c236-0363-438b-b925-96be085e8c32 tempest-GroupsTest-1953933537 None] Group tempest-Group1-676233989: creating Sep 28 05:12:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dcf8c236-0363-438b-b925-96be085e8c32 tempest-GroupsTest-1953933537 None] Group tempest-Group1-676233989: created successfully Sep 28 05:12:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dcf8c236-0363-438b-b925-96be085e8c32 tempest-GroupsTest-1953933537 None] Create group completed successfully. Sep 28 05:12:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-26b9d08f-b621-45c1-ba9f-aa7a7332f317 tempest-GroupsTest-1953933537 None] Group tempest-Group2-325110844: creating Sep 28 05:12:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-26b9d08f-b621-45c1-ba9f-aa7a7332f317 tempest-GroupsTest-1953933537 None] Group tempest-Group2-325110844: created successfully Sep 28 05:12:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-26b9d08f-b621-45c1-ba9f-aa7a7332f317 tempest-GroupsTest-1953933537 None] Create group completed successfully. Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "cinder-2527e037-c96b-4300-a3c9-04dc4100bc16-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-2527e037-c96b-4300-a3c9-04dc4100bc16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "cinder-quobyte-2527e037-c96b-4300-a3c9-04dc4100bc16" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-2527e037-c96b-4300-a3c9-04dc4100bc16" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Deleting offline snapshot 2527e037-c96b-4300-a3c9-04dc4100bc16 of volume cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] snapshot_file for this snap is: volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8f77f-30f4-4069-99ca-72737686bc87]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:21 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 Sep 28 05:12:21 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:22 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16" returned: 0 in 0.469s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd9de651-6c63-45df-a68b-9161ccedf5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36a3d5-4880-49cd-8415-9897f2c6fac7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:22 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd Sep 28 05:12:22 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:22 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd" returned: 0 in 0.407s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:22 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 Sep 28 05:12:22 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (c2f6a659-2459-46f3-8a8a-6ef1367c27ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007e7ec4-b662-42e2-8793-c8d18842653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007e7ec4-b662-42e2-8793-c8d18842653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074987757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6f33187-6e3b-4c9d-84db-0db921b27d44,host='devstack@QuobyteHD#QuobyteHD',id=5a29844d-f9ca-4c92-a364-7d617deef3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:23Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312fb3cd-5c6e-4512-9989-6ab54b06432e),volume_type_id=312fb3cd-5c6e-4512-9989-6ab54b06432e)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeefd1d-f967-4827-bda1-31b418540102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeefd1d-f967-4827-bda1-31b418540102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9879d42-c3fd-4797-9170-1c358db3820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9879d42-c3fd-4797-9170-1c358db3820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a29844d-f9ca-4c92-a364-7d617deef3b6', 'volume_name': 'volume-5a29844d-f9ca-4c92-a364-7d617deef3b6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550ec3e8-311b-4631-bf80-fd8653c7a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550ec3e8-311b-4631-bf80-fd8653c7a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e4cce8-8717-4ae4-a7dc-d015262167ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:22 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Volume 5a29844d-f9ca-4c92-a364-7d617deef3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a29844d-f9ca-4c92-a364-7d617deef3b6', 'volume_size': 1} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6f33187-6e3b-4c9d-84db-0db921b27d44,created_at=2026-09-28T03:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074987757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6f33187-6e3b-4c9d-84db-0db921b27d44,host='devstack@QuobyteHD#QuobyteHD',id=5a29844d-f9ca-4c92-a364-7d617deef3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:23Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312fb3cd-5c6e-4512-9989-6ab54b06432e),volume_type_id=312fb3cd-5c6e-4512-9989-6ab54b06432e)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Creating volume 5a29844d-f9ca-4c92-a364-7d617deef3b6 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:22 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:22 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 1073741824 Sep 28 05:12:22 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:23 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16" returned: 0 in 0.514s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:23 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16 Sep 28 05:12:23 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:23 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 1073741824" returned: 0 in 0.610s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:23 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd.2527e037-c96b-4300-a3c9-04dc4100bc16" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-2527e037-c96b-4300-a3c9-04dc4100bc16" released by "_delete_snapshot" :: held 1.831s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" released by "delete_snapshot" :: held 1.871s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:23 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 Sep 28 05:12:23 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Created reservations ['8b4638d2-963b-4835-8959-9835303056c4', '1140deeb-7460-4c57-85a0-25cfd584d16d', 'ccf1c1fe-3a07-4829-b5ed-e6b06a71e486', 'd7560397-d374-4942-b0c5-31528449e0dd'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Delete snapshot completed successfully. Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d17e13a4-1c11-4c26-874b-96302ad55e28 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-2527e037-c96b-4300-a3c9-04dc4100bc16-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:23 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e4cce8-8717-4ae4-a7dc-d015262167ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a29844d-f9ca-4c92-a364-7d617deef3b6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecae9adc-e720-4976-8852-d894ba3a0614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Volume volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 (5a29844d-f9ca-4c92-a364-7d617deef3b6): created successfully Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecae9adc-e720-4976-8852-d894ba3a0614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (c2f6a659-2459-46f3-8a8a-6ef1367c27ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0c91a993-3068-416c-9b12-0b8d4e2b741a tempest-GroupsTest-1953933537 None] Created volume successfully. Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "cinder-cd9de651-6c63-45df-a68b-9161ccedf5cd-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-cd9de651-6c63-45df-a68b-9161ccedf5cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa25481-69db-4741-beb1-63a915666767]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:24 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd Sep 28 05:12:24 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:24 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:24 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd Sep 28 05:12:24 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:24 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd9de651-6c63-45df-a68b-9161ccedf5cd" returned: 0 in 0.252s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-quobyte-cd9de651-6c63-45df-a68b-9161ccedf5cd" released by "delete_volume" :: held 0.703s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Created reservations ['2e1cc672-6fd8-4a70-8265-b1104c3cfe47', '8dc2cb65-65fc-4039-8a66-323cf576c2cd', '13e432d1-110a-49f6-ad71-02ec42e53507', '68bdaa59-5cd4-41fe-ac2d-c1951c2f15e1'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:24 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:24 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:25 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Deleted volume successfully. Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ba580a1b-2b91-4bfe-ba33-6151af464626 tempest-SnapshotMetadataTestJSON-2027272897 None] Lock "cinder-cd9de651-6c63-45df-a68b-9161ccedf5cd-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Acquiring lock "cinder-quobyte-5a29844d-f9ca-4c92-a364-7d617deef3b6" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-5a29844d-f9ca-4c92-a364-7d617deef3b6" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c7d3a-1d15-4cbf-a4bf-35ed08464f3b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:26 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 Sep 28 05:12:26 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:26 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6" returned: 0 in 0.444s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:26 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6 Sep 28 05:12:26 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:26 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5a29844d-f9ca-4c92-a364-7d617deef3b6" returned: 0 in 0.275s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-5a29844d-f9ca-4c92-a364-7d617deef3b6" released by "delete_volume" :: held 0.829s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Created reservations ['91a76d6c-0ce3-4d9e-a6d0-76986d2fb6c6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:26 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-116158520 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-116158520, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:26 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-116158520 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-116158520, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Created reservations ['8984e184-f002-4fc1-ad7f-63755e15abae', '3ed23b15-fbbe-4b5c-8b58-d861bf1ec066', 'bec7444d-9644-4f80-b1de-09c0690e678c', '4dfc09e6-de96-4f07-8be2-a0ef5c6bc4eb'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:26 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:26 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:27 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.336s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Created reservations ['ac824370-2382-44f7-915c-e088cf61394c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4b5759ab-fc44-4d12-822c-58fcd2aa8424 tempest-GroupsTest-1953933537 None] Delete group completed successfully. Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:27 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:27 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:27 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.268s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-48b627a1-9d46-4335-9948-97fe72151ae9 tempest-GroupsTest-1953933537 None] Delete group completed successfully. Sep 28 05:12:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-59a75e0b-3412-40c6-ac2b-777ed812c6be tempest-GroupsTest-1953933537 None] Group tempest-GroupsTest-Group-1762388962: creating Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=121,cinder:DELETE=3,cinder:SELECT=125,cinder:INSERT=32 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:12:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-59a75e0b-3412-40c6-ac2b-777ed812c6be tempest-GroupsTest-1953933537 None] Group tempest-GroupsTest-Group-1762388962: created successfully Sep 28 05:12:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-59a75e0b-3412-40c6-ac2b-777ed812c6be tempest-GroupsTest-1953933537 None] Create group completed successfully. Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:29 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:29 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:29 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:12:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (98fff2f8-709e-418d-a624-d34b890547b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a291638c-d01b-4946-bdde-2069971c08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a291638c-d01b-4946-bdde-2069971c08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2139601817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d53077c5-a529-474f-9ab6-d878199c97d3,host='devstack@QuobyteHD#QuobyteHD',id=3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:31Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8341-cb40-4d4a-963b-63c3d17ca5eb),volume_type_id=72de8341-cb40-4d4a-963b-63c3d17ca5eb)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6015e14a-1485-42ac-a35e-c18eb035b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6015e14a-1485-42ac-a35e-c18eb035b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a361b0c-7535-4ad9-8bab-285aa8a0bfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a361b0c-7535-4ad9-8bab-285aa8a0bfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2', 'volume_name': 'volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1616abb0-c7ba-4553-8ff6-a9c36de6e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1616abb0-c7ba-4553-8ff6-a9c36de6e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824edf0d-8959-487c-8c52-c7155329b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:30 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Volume 3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2', 'volume_size': 1} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d53077c5-a529-474f-9ab6-d878199c97d3,created_at=2026-09-28T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2139601817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d53077c5-a529-474f-9ab6-d878199c97d3,host='devstack@QuobyteHD#QuobyteHD',id=3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:31Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8341-cb40-4d4a-963b-63c3d17ca5eb),volume_type_id=72de8341-cb40-4d4a-963b-63c3d17ca5eb)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Creating volume 3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:30 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:31 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 1073741824 Sep 28 05:12:31 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Flow 'volume_create_manager' (c4fb3c8a-abad-4893-8353-88f66755027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bbba21-32b4-43f4-9a5f-60bd0501c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bbba21-32b4-43f4-9a5f-60bd0501c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521246336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9ea977-a6c9-40a7-ba0a-498b87b91350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a183c9d37714e6f9086c1ffa7d58afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:31Z,use_quota=True,user_id='2745250668ff404dbf18f65d5b7b92d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b909571-fa65-4ed0-880e-f32c16d565b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b909571-fa65-4ed0-880e-f32c16d565b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28058d0-2027-4923-a795-35a1f21f7cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28058d0-2027-4923-a795-35a1f21f7cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9ea977-a6c9-40a7-ba0a-498b87b91350', 'volume_name': 'volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe996fa5-2d30-4e93-8f81-8c59a1372591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe996fa5-2d30-4e93-8f81-8c59a1372591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9253430f-1003-4de1-8b3f-f04df4a7d984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:31 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Volume 0a9ea977-a6c9-40a7-ba0a-498b87b91350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350', 'volume_size': 1} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:31 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 1073741824" returned: 0 in 0.584s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:31 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 Sep 28 05:12:31 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:32 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521246336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9ea977-a6c9-40a7-ba0a-498b87b91350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a183c9d37714e6f9086c1ffa7d58afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:31Z,use_quota=True,user_id='2745250668ff404dbf18f65d5b7b92d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Creating volume 0a9ea977-a6c9-40a7-ba0a-498b87b91350 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:32 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:32 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 1073741824 Sep 28 05:12:32 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824edf0d-8959-487c-8c52-c7155329b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a52fa1-9115-48bb-82d1-9144125e9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Volume volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 (3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2): created successfully Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a52fa1-9115-48bb-82d1-9144125e9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (98fff2f8-709e-418d-a624-d34b890547b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-70ba5b4b-45b0-4ee4-ba09-eaab9820ce7b tempest-GroupsTest-1953933537 None] Created volume successfully. Sep 28 05:12:32 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 1073741824" returned: 0 in 0.631s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:32 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 Sep 28 05:12:32 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:33 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9253430f-1003-4de1-8b3f-f04df4a7d984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98326c7-7d96-4aaa-a4c6-f8b39ce97ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:33 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Volume volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 (0a9ea977-a6c9-40a7-ba0a-498b87b91350): created successfully Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98326c7-7d96-4aaa-a4c6-f8b39ce97ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Flow 'volume_create_manager' (c4fb3c8a-abad-4893-8353-88f66755027a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cec42b4f-4d35-4981-ada2-3013d4b36fea tempest-VolumesTransfersV355Test-404124082 None] Created volume successfully. Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (06bf9b4d-b67a-4b40-a997-98939fa397b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01694e51-e550-4938-9981-d0ab19618aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01694e51-e550-4938-9981-d0ab19618aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228872315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d53077c5-a529-474f-9ab6-d878199c97d3,host='devstack@QuobyteHD#QuobyteHD',id=eb21d2df-4cd8-423f-bac3-f8f76244737f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:34Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8341-cb40-4d4a-963b-63c3d17ca5eb),volume_type_id=72de8341-cb40-4d4a-963b-63c3d17ca5eb)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5d700a-c521-4007-adee-7d705607cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5d700a-c521-4007-adee-7d705607cffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3db2ee-4cbc-483f-84d2-8d98872499c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3db2ee-4cbc-483f-84d2-8d98872499c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb21d2df-4cd8-423f-bac3-f8f76244737f', 'volume_name': 'volume-eb21d2df-4cd8-423f-bac3-f8f76244737f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39597113-621e-425e-bf27-0df98d9d35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39597113-621e-425e-bf27-0df98d9d35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87f0cd-043b-47cd-94a6-670b877e8060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:34 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Volume eb21d2df-4cd8-423f-bac3-f8f76244737f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb21d2df-4cd8-423f-bac3-f8f76244737f', 'volume_size': 1} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d53077c5-a529-474f-9ab6-d878199c97d3,created_at=2026-09-28T03:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228872315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d53077c5-a529-474f-9ab6-d878199c97d3,host='devstack@QuobyteHD#QuobyteHD',id=eb21d2df-4cd8-423f-bac3-f8f76244737f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e21ac7b64fe4fd8b73badd01aabf2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:34Z,use_quota=True,user_id='a713b9a1d53d45218b993419ccf35586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72de8341-cb40-4d4a-963b-63c3d17ca5eb),volume_type_id=72de8341-cb40-4d4a-963b-63c3d17ca5eb)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Creating volume eb21d2df-4cd8-423f-bac3-f8f76244737f {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:34 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:34 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f 1073741824 Sep 28 05:12:34 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:34 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f 1073741824" returned: 0 in 0.570s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:34 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f Sep 28 05:12:34 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:35 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87f0cd-043b-47cd-94a6-670b877e8060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb21d2df-4cd8-423f-bac3-f8f76244737f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b5a774-6d17-498c-8cc1-00d67f671e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:35 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Volume volume-eb21d2df-4cd8-423f-bac3-f8f76244737f (eb21d2df-4cd8-423f-bac3-f8f76244737f): created successfully Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b5a774-6d17-498c-8cc1-00d67f671e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Flow 'volume_create_manager' (06bf9b4d-b67a-4b40-a997-98939fa397b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4ed78576-f343-41b8-a576-32b9b482bbd3 tempest-GroupsTest-1953933537 None] Created volume successfully. Sep 28 05:12:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0712823e-5abb-413b-8329-fed38fb1993e tempest-VolumesTransfersV355Test-1738454165 None] Transfer volume completed successfully. Sep 28 05:12:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "cinder-0a9ea977-a6c9-40a7-ba0a-498b87b91350-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-0a9ea977-a6c9-40a7-ba0a-498b87b91350-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "cinder-quobyte-0a9ea977-a6c9-40a7-ba0a-498b87b91350" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-quobyte-0a9ea977-a6c9-40a7-ba0a-498b87b91350" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90617b-24a2-4f39-830c-f2ce286ac4d5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:36 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 Sep 28 05:12:36 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:36 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350" returned: 0 in 0.436s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:36 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350 Sep 28 05:12:36 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e8a84868-e7e3-469a-8ca6-d4e807a82c82 tempest-GroupsTest-1953933537 None] Update group completed successfully. Sep 28 05:12:36 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0a9ea977-a6c9-40a7-ba0a-498b87b91350" returned: 0 in 0.302s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-quobyte-0a9ea977-a6c9-40a7-ba0a-498b87b91350" released by "delete_volume" :: held 0.803s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:36 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Created reservations ['9d69c906-6e4e-4e5c-9da5-913078d70958', 'f7ddb865-5465-4e40-8fc1-d455b97420c8', 'e9adcef4-f195-4068-8c83-8cda893d53ba', 'ce74f10e-5cfb-4cc5-98b9-75f9ecd71cda'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:37 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:37 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:37 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Deleted volume successfully. Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-adcdb3ab-2932-4f7b-a297-f412c8b4ba0b tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-0a9ea977-a6c9-40a7-ba0a-498b87b91350-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Flow 'volume_create_manager' (eda81a53-c597-49ad-a414-28f4ab9726ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfad461-3cff-4a81-9339-7c6cd5a8e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfad461-3cff-4a81-9339-7c6cd5a8e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541276693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a183c9d37714e6f9086c1ffa7d58afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:38Z,use_quota=True,user_id='2745250668ff404dbf18f65d5b7b92d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99c0c4f-39eb-49f2-8791-f79197248f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99c0c4f-39eb-49f2-8791-f79197248f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a094f79-3d4a-4ca9-8aec-ef45e0bf9870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a094f79-3d4a-4ca9-8aec-ef45e0bf9870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8', 'volume_name': 'volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168749c4-4c3e-4129-b918-0534fa0817ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168749c4-4c3e-4129-b918-0534fa0817ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d484cf-59d5-407a-abc0-dfb6b7061898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Volume 10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8', 'volume_size': 1} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541276693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a183c9d37714e6f9086c1ffa7d58afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:38Z,use_quota=True,user_id='2745250668ff404dbf18f65d5b7b92d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Creating volume 10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:37 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 1073741824 Sep 28 05:12:37 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5faf6641-c76c-4efd-977d-96b2c268aa46 tempest-GroupsTest-1953933537 None] Update group completed successfully. Sep 28 05:12:38 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 1073741824" returned: 0 in 0.487s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:38 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 Sep 28 05:12:38 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:38 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d484cf-59d5-407a-abc0-dfb6b7061898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f842c1-85c2-4e68-8da7-bde8e249da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Volume volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 (10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8): created successfully Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f842c1-85c2-4e68-8da7-bde8e249da62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Flow 'volume_create_manager' (eda81a53-c597-49ad-a414-28f4ab9726ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dcee4c94-67b7-431e-a9c7-95759044215a tempest-VolumesTransfersV355Test-404124082 None] Created volume successfully. Sep 28 05:12:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Acquiring lock "cinder-quobyte-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20138987-9f72-4743-8931-1d60f0ccd352]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:39 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 Sep 28 05:12:39 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "cinder-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "cinder-quobyte-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-quobyte-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:40 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" returned: 0 in 0.527s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920a1b8-071d-4071-bbb6-c2be1d0c9acc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:40 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2 Sep 28 05:12:40 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:40 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 Sep 28 05:12:40 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:40 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-3ae7a342-a070-4f4c-bfde-2a34a0f4b2b2" released by "delete_volume" :: held 0.931s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Acquiring lock "cinder-quobyte-eb21d2df-4cd8-423f-bac3-f8f76244737f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-eb21d2df-4cd8-423f-bac3-f8f76244737f" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad0978-6df8-4341-bf87-97d182cb15b8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:40 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:40 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f Sep 28 05:12:40 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:40 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8 Sep 28 05:12:40 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:41 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f" returned: 0 in 0.443s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:41 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f Sep 28 05:12:41 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:41 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-quobyte-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8" released by "delete_volume" :: held 0.952s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Created reservations ['6d896f42-7b4e-41d0-8b6a-7269ebb7fed4', 'f66a05b0-f8e8-4187-8db8-36e6ed736128', '5bd8b2c8-e9a6-4b4e-ae97-0d754342370c', 'e3b65959-b3e3-4466-b237-18bdfba6323c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:41 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:41 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:41 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eb21d2df-4cd8-423f-bac3-f8f76244737f" returned: 0 in 0.413s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "cinder-quobyte-eb21d2df-4cd8-423f-bac3-f8f76244737f" released by "delete_volume" :: held 0.945s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Created reservations ['3355adab-9d57-4e26-b93b-916309411453'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:41 devstack cinder-volume[86815]: WARNING cinder.quota [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1382143402 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1382143402, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:41 devstack cinder-volume[86815]: WARNING cinder.quota [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1382143402 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1382143402, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Created reservations ['ab601c24-ac6a-42ba-a433-dabd7226e639', '099ca076-c1ec-4efa-8aa5-a7d7417d0d61', '224ae936-c083-4967-ad6f-be7921009c13', '85b9f64b-735e-4ccb-a98e-bb3c9f2530cb'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:41 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.383s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Deleted volume successfully. Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-30e76499-f33f-4bb5-b538-88e03a4770de tempest-VolumesTransfersV355Test-1369708496 None] Lock "cinder-10f008cb-7bb9-4a3c-9a2d-3b91a4c3e4e8-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:41 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Created reservations ['4ec5cbaa-47c2-4319-8deb-2a7d9004ba4a', '7699e9dc-88ff-4b7e-aa99-7aa1951eea8f', 'c410a417-8f1c-4fa0-97cf-c8c9bec9d007', '21648a40-e5b3-4847-b487-5f75e7d4d635'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:42 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:42 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:42 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:42 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e7086e63-4075-494d-9e73-9dffe111ed75 tempest-GroupsTest-1953933537 None] Delete group completed successfully. Sep 28 05:12:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-5e2dc8eb-8ad1-4f2e-8ed5-01da32da158d req-44f254b5-320f-4113-886d-da1b574cb6ab tempest-TestMinimumBasicScenario-940597612 None] Terminate volume connection completed successfully. Sep 28 05:12:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-5e2dc8eb-8ad1-4f2e-8ed5-01da32da158d req-44f254b5-320f-4113-886d-da1b574cb6ab tempest-TestMinimumBasicScenario-940597612 None] Deleting attachment 358929ec-3fe5-4fba-960a-14fd5b7736f6. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "cinder-159c90bd-fa32-4d64-b231-b9a427f70e14-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "cinder-159c90bd-fa32-4d64-b231-b9a427f70e14-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "cinder-quobyte-159c90bd-fa32-4d64-b231-b9a427f70e14" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "cinder-quobyte-159c90bd-fa32-4d64-b231-b9a427f70e14" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d790f5-b40f-4520-a3f2-952ef2425779]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:12:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:52 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 Sep 28 05:12:52 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:52 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14" returned: 0 in 0.463s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:52 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14 Sep 28 05:12:52 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:52 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-159c90bd-fa32-4d64-b231-b9a427f70e14" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "cinder-quobyte-159c90bd-fa32-4d64-b231-b9a427f70e14" released by "delete_volume" :: held 0.845s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Created reservations ['cef563f5-8bb9-471b-bc3e-24dc83cf602b', '06f15636-b824-43d3-bd08-102a9e6f1485', '7366d94b-4430-464e-a744-2dfbb72563a8', '2bf02f25-b462-4220-9e51-40b741afbfc0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:52 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:52 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:53 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.538s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:53 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:53 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Deleted volume successfully. Sep 28 05:12:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7d4fe521-6f85-425d-99a9-56d587ef1807 tempest-TestMinimumBasicScenario-940597612 None] Lock "cinder-159c90bd-fa32-4d64-b231-b9a427f70e14-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:12:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-19eeedf7-8945-4ec0-b41a-ccdc5093c381 tempest-GroupsV320Test-285650341 None] Group tempest-GroupsV320Test-Group-60805332: creating Sep 28 05:12:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-19eeedf7-8945-4ec0-b41a-ccdc5093c381 tempest-GroupsV320Test-285650341 None] Group tempest-GroupsV320Test-Group-60805332: created successfully Sep 28 05:12:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-19eeedf7-8945-4ec0-b41a-ccdc5093c381 tempest-GroupsV320Test-285650341 None] Create group completed successfully. Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Created reservations ['fc70ceed-c128-4995-90df-63267ff7e2ec'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:57 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:12:57 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:57 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.350s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:57 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:12:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8636d4ac-17a9-4fc5-a7ce-f8a2cea8d5ed tempest-GroupsV320Test-285650341 None] Delete group completed successfully. Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Flow 'volume_create_manager' (8f0d8933-98c9-4bf7-a01e-dbb7b0dbdd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea00477-f154-4b9e-bd99-616552f40da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea00477-f154-4b9e-bd99-616552f40da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-730811804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc912b6d-eda5-4fe0-b981-9b3fe562817e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812f5b3ced2842bb9e2df3a3adceb744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:58Z,use_quota=True,user_id='53e2dccfcc9d4d5aa73c4863da05d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb994511-e644-473a-b537-19fe5eab83b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb994511-e644-473a-b537-19fe5eab83b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb80163-2899-49ef-bda1-e2e86fefad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb80163-2899-49ef-bda1-e2e86fefad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc912b6d-eda5-4fe0-b981-9b3fe562817e', 'volume_name': 'volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26184acf-fbfd-4076-b11a-6a38bedc1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26184acf-fbfd-4076-b11a-6a38bedc1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c40a5f-393d-4c68-8a23-4ab0331c1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:58 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Volume fc912b6d-eda5-4fe0-b981-9b3fe562817e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e', 'volume_size': 1} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-730811804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc912b6d-eda5-4fe0-b981-9b3fe562817e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812f5b3ced2842bb9e2df3a3adceb744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:12:58Z,use_quota=True,user_id='53e2dccfcc9d4d5aa73c4863da05d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Creating volume fc912b6d-eda5-4fe0-b981-9b3fe562817e {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:12:58 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:12:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:58 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e 1073741824 Sep 28 05:12:58 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:59 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e 1073741824" returned: 0 in 0.662s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:12:59 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e Sep 28 05:12:59 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:12:59 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c40a5f-393d-4c68-8a23-4ab0331c1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850dc51b-bd69-4638-819b-dd301d138214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:12:59 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Volume volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e (fc912b6d-eda5-4fe0-b981-9b3fe562817e): created successfully Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850dc51b-bd69-4638-819b-dd301d138214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:12:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Flow 'volume_create_manager' (8f0d8933-98c9-4bf7-a01e-dbb7b0dbdd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:12:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c96a6408-bcde-418c-b005-fdf76e7cd719 tempest-VolumesTransfersV357Test-657750466 None] Created volume successfully. Sep 28 05:13:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-58acc34f-cad5-4890-b50a-4c284c3a56b1 tempest-VolumesTransfersV357Test-1448992369 None] Transfer volume completed successfully. Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "cinder-fc912b6d-eda5-4fe0-b981-9b3fe562817e-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-fc912b6d-eda5-4fe0-b981-9b3fe562817e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "cinder-quobyte-fc912b6d-eda5-4fe0-b981-9b3fe562817e" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-quobyte-fc912b6d-eda5-4fe0-b981-9b3fe562817e" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b42f2-52d2-4e69-9385-a0169c59a1f3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:02 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e Sep 28 05:13:02 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:03 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e" returned: 0 in 0.406s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:03 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e Sep 28 05:13:03 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:03 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc912b6d-eda5-4fe0-b981-9b3fe562817e" returned: 0 in 0.308s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-quobyte-fc912b6d-eda5-4fe0-b981-9b3fe562817e" released by "delete_volume" :: held 0.763s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Created reservations ['22a45f5b-45a6-4411-9311-b395fd739426', 'a66c22a9-13c8-4274-8b12-35c375fcf0b0', '75884996-aa73-4cbd-b176-e86ed80dc3c8', '2f3a7f1c-ef0c-4774-aa21-dc2635946804'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:03 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:03 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:03 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Deleted volume successfully. Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ae35c111-bb29-4e59-9a3f-ee2d0e3ba512 tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-fc912b6d-eda5-4fe0-b981-9b3fe562817e-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Flow 'volume_create_manager' (0f192320-2345-46ca-be93-dfbb083a4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b64111-c098-460f-8d36-d002d1899b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b64111-c098-460f-8d36-d002d1899b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1258037530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812f5b3ced2842bb9e2df3a3adceb744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:04Z,use_quota=True,user_id='53e2dccfcc9d4d5aa73c4863da05d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243dfd32-a2f7-4ce9-b9cd-f986a33199b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243dfd32-a2f7-4ce9-b9cd-f986a33199b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1776b0-ced7-46ca-9dac-81bbedd70c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1776b0-ced7-46ca-9dac-81bbedd70c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98', 'volume_name': 'volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e5d844-ff59-448d-973c-db2a832c913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e5d844-ff59-448d-973c-db2a832c913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77271f0c-0b6e-4468-9a1f-f5efcc9bffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:04 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Volume 8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98', 'volume_size': 1} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1258037530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812f5b3ced2842bb9e2df3a3adceb744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:04Z,use_quota=True,user_id='53e2dccfcc9d4d5aa73c4863da05d830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Creating volume 8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:04 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:04 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 1073741824 Sep 28 05:13:04 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:05 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 1073741824" returned: 0 in 0.505s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:05 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 Sep 28 05:13:05 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:05 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" returned: 0 in 0.327s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77271f0c-0b6e-4468-9a1f-f5efcc9bffbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ffcc9e-f36d-4953-9bb3-302d184f1ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:05 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Volume volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 (8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98): created successfully Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ffcc9e-f36d-4953-9bb3-302d184f1ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Flow 'volume_create_manager' (0f192320-2345-46ca-be93-dfbb083a4956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-55579807-ddaf-467f-a592-8d86f45328f0 tempest-VolumesTransfersV357Test-657750466 None] Created volume successfully. Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Flow 'volume_create_manager' (f108cd25-d3a4-46e6-9e44-91a411300a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b698711-2986-4260-aa79-bddaf449471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b698711-2986-4260-aa79-bddaf449471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-47790925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c9a4ab-eeef-4db0-b098-3e176278088d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b87efb7e00418294e28ed9185598c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:07Z,use_quota=True,user_id='ea6042b9ec704c8bbe9c3093a7972cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a97e0ff-2d9c-418a-8da3-0f8a5b709292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a97e0ff-2d9c-418a-8da3-0f8a5b709292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fa130-b30f-4c34-afcd-7321e479d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805fa130-b30f-4c34-afcd-7321e479d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c9a4ab-eeef-4db0-b098-3e176278088d', 'volume_name': 'volume-d0c9a4ab-eeef-4db0-b098-3e176278088d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c340c18-a388-4f9e-bbd8-d16ff4d2e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c340c18-a388-4f9e-bbd8-d16ff4d2e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bf784f-a793-485a-93fa-4b21d0c39d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume d0c9a4ab-eeef-4db0-b098-3e176278088d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c9a4ab-eeef-4db0-b098-3e176278088d', 'volume_size': 1} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-47790925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c9a4ab-eeef-4db0-b098-3e176278088d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b87efb7e00418294e28ed9185598c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:07Z,use_quota=True,user_id='ea6042b9ec704c8bbe9c3093a7972cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Creating volume d0c9a4ab-eeef-4db0-b098-3e176278088d {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:06 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:06 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d 1073741824 Sep 28 05:13:06 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "cinder-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "cinder-quobyte-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-quobyte-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc3310-42ba-4bae-8839-b9d35c19c82f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:07 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 Sep 28 05:13:07 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:07 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d 1073741824" returned: 0 in 0.709s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:07 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d Sep 28 05:13:07 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:07 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" returned: 0 in 0.570s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:07 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98 Sep 28 05:13:07 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:08 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d" returned: 0 in 0.442s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bf784f-a793-485a-93fa-4b21d0c39d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c9a4ab-eeef-4db0-b098-3e176278088d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d38bc8-84b9-4c98-b2d5-b35746527aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume volume-d0c9a4ab-eeef-4db0-b098-3e176278088d (d0c9a4ab-eeef-4db0-b098-3e176278088d): created successfully Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d38bc8-84b9-4c98-b2d5-b35746527aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Flow 'volume_create_manager' (f108cd25-d3a4-46e6-9e44-91a411300a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-21bcc447-5bec-4885-9705-2bd5cd441752 tempest-VolumeQuotasAdminTestJSON-879559700 None] Created volume successfully. Sep 28 05:13:08 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" returned: 0 in 0.360s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-quobyte-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98" released by "delete_volume" :: held 0.995s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Created reservations ['87334d70-7f99-4c7d-b28a-9918bff0b5d5', 'eb85367e-1527-40ca-b18e-6f6a32bc3c3c', 'de7df448-2473-47b0-9b7a-29b5319cc227', '668450af-0a84-40d2-8f24-8aaa18dcbce3'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:08 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:08 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:08 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.267s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Deleted volume successfully. Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-590bfd5c-ce42-41d3-a442-9138ae2846fd tempest-VolumesTransfersV357Test-1121219373 None] Lock "cinder-8b9d6ca5-9ca0-4d80-bec0-a5aa012bfc98-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "cinder-d0c9a4ab-eeef-4db0-b098-3e176278088d-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "cinder-d0c9a4ab-eeef-4db0-b098-3e176278088d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "cinder-quobyte-d0c9a4ab-eeef-4db0-b098-3e176278088d" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "cinder-quobyte-d0c9a4ab-eeef-4db0-b098-3e176278088d" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6cd6c6-da87-4d1f-a88f-8f680fd249cf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:09 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d Sep 28 05:13:09 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:09 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d" returned: 0 in 0.394s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:09 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d Sep 28 05:13:09 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:09 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d0c9a4ab-eeef-4db0-b098-3e176278088d" returned: 0 in 0.296s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "cinder-quobyte-d0c9a4ab-eeef-4db0-b098-3e176278088d" released by "delete_volume" :: held 0.759s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Created reservations ['6e6304d6-9f20-497c-9340-fa7970a1f72f', '80cc2f63-85e9-483f-a974-1e27d6fe6dac', '604d7a07-9f94-4e9f-9a84-0c9fec0c8be4', 'e99b0c56-a47d-4e9b-919c-c29a7c9cc54f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:09 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:09 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:10 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Deleted volume successfully. Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e1cb575e-ac4f-4919-8edd-b7582b3131ee tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "cinder-d0c9a4ab-eeef-4db0-b098-3e176278088d-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Flow 'volume_create_manager' (3cb9ccbc-27b4-40d9-a427-925a7e7127e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd180f04-ddc0-4665-98ed-d9ddca7acd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd180f04-ddc0-4665-98ed-d9ddca7acd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1502564523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b0645-8874-40d4-8119-0ddbc3256410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b87efb7e00418294e28ed9185598c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:11Z,use_quota=True,user_id='ea6042b9ec704c8bbe9c3093a7972cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d97289-92b7-40eb-833d-9e3b7958fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d97289-92b7-40eb-833d-9e3b7958fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4660fb-820d-4bb5-8fc0-bf0ef82cc905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4660fb-820d-4bb5-8fc0-bf0ef82cc905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8b0645-8874-40d4-8119-0ddbc3256410', 'volume_name': 'volume-5f8b0645-8874-40d4-8119-0ddbc3256410', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ffe1b-1d74-4688-8bb4-b770efad5075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ffe1b-1d74-4688-8bb4-b770efad5075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be4465c-7ec6-4f5f-b127-4d8fd87070a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume 5f8b0645-8874-40d4-8119-0ddbc3256410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8b0645-8874-40d4-8119-0ddbc3256410', 'volume_size': 1} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1502564523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8b0645-8874-40d4-8119-0ddbc3256410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b87efb7e00418294e28ed9185598c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:11Z,use_quota=True,user_id='ea6042b9ec704c8bbe9c3093a7972cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Creating volume 5f8b0645-8874-40d4-8119-0ddbc3256410 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:10 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:10 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 1073741824 Sep 28 05:13:10 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:11 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 1073741824" returned: 0 in 0.515s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:11 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 Sep 28 05:13:11 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:11 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410" returned: 0 in 0.308s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be4465c-7ec6-4f5f-b127-4d8fd87070a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8b0645-8874-40d4-8119-0ddbc3256410', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825a752e-1c00-40e6-9363-986865f90147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Volume volume-5f8b0645-8874-40d4-8119-0ddbc3256410 (5f8b0645-8874-40d4-8119-0ddbc3256410): created successfully Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825a752e-1c00-40e6-9363-986865f90147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Flow 'volume_create_manager' (3cb9ccbc-27b4-40d9-a427-925a7e7127e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-85112c60-2c16-4416-b842-b2221b0a7a5e tempest-VolumeQuotasAdminTestJSON-879559700 None] Created volume successfully. Sep 28 05:13:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5d8b2e4c-4cba-41f4-9a0a-ab8f87d3c96f tempest-VolumeQuotasAdminTestJSON-139915629 None] Transfer volume completed successfully. Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (636b4005-fb5f-4ba0-a695-fd9eb6455110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0ab168-c964-41d1-859f-828b240b5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0ab168-c964-41d1-859f-828b240b5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1730844790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad747e76-d285-442b-a428-1d201c118322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:14Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527165c2-26b0-45de-8032-3a47e621e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527165c2-26b0-45de-8032-3a47e621e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce45471-fd65-4d95-ba8e-db309a32ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce45471-fd65-4d95-ba8e-db309a32ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad747e76-d285-442b-a428-1d201c118322', 'volume_name': 'volume-ad747e76-d285-442b-a428-1d201c118322', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a3d4f0-ddf1-4fbb-b8ed-7a18b9bec6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a3d4f0-ddf1-4fbb-b8ed-7a18b9bec6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ed7288-fc85-490c-8d7b-4830bc62ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Volume ad747e76-d285-442b-a428-1d201c118322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad747e76-d285-442b-a428-1d201c118322', 'volume_size': 1} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1730844790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad747e76-d285-442b-a428-1d201c118322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:14Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Creating volume ad747e76-d285-442b-a428-1d201c118322 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:14 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 1073741824 Sep 28 05:13:14 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Acquiring lock "cinder-5f8b0645-8874-40d4-8119-0ddbc3256410-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "cinder-5f8b0645-8874-40d4-8119-0ddbc3256410-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Acquiring lock "cinder-quobyte-5f8b0645-8874-40d4-8119-0ddbc3256410" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "cinder-quobyte-5f8b0645-8874-40d4-8119-0ddbc3256410" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ba4f4-da7f-4bb4-8f88-79ee3e95d60f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:14 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 1073741824" returned: 0 in 0.659s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:14 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 Sep 28 05:13:14 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:14 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 Sep 28 05:13:14 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:14 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ed7288-fc85-490c-8d7b-4830bc62ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad747e76-d285-442b-a428-1d201c118322', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4827ef-c204-427d-a4aa-2915b4c7c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:15 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410" returned: 0 in 0.491s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Volume volume-ad747e76-d285-442b-a428-1d201c118322 (ad747e76-d285-442b-a428-1d201c118322): created successfully Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4827ef-c204-427d-a4aa-2915b4c7c619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (636b4005-fb5f-4ba0-a695-fd9eb6455110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:15 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410 Sep 28 05:13:15 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-00d39bff-5bf3-443a-bea1-22f7da81c954 tempest-AttachVolumeTestJSON-547550533 None] Created volume successfully. Sep 28 05:13:15 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5f8b0645-8874-40d4-8119-0ddbc3256410" returned: 0 in 0.290s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "cinder-quobyte-5f8b0645-8874-40d4-8119-0ddbc3256410" released by "delete_volume" :: held 0.836s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=115,cinder:INSERT=30,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Created reservations ['3d3ef71e-fa1d-4d8d-b85c-73ab3494831e', '35f35b86-0f9c-434e-a343-721d23c75c33', '8b200cfd-a5c9-4572-96ea-83c3139a3771', '8ea2d2eb-8821-48af-b530-7adbadcc3f11'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:15 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:15 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:15 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Deleted volume successfully. Sep 28 05:13:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-824d8ee9-43d7-46dc-be47-79b569ca699a tempest-VolumeQuotasAdminTestJSON-1192497215 None] Lock "cinder-5f8b0645-8874-40d4-8119-0ddbc3256410-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Flow 'volume_create_manager' (1999ceec-5482-4eea-ba7c-618eb80c6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb39eab-f838-492e-9060-c847741b008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-bd1ad5df-e371-44d6-9e74-8758fd4c6390 req-6c284c92-b55d-442e-bf0f-a78e6b3b8875 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-bd1ad5df-e371-44d6-9e74-8758fd4c6390 req-6c284c92-b55d-442e-bf0f-a78e6b3b8875 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb39eab-f838-492e-9060-c847741b008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2135775699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e57f3de-8167-4878-8a79-1bb2741d88af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9573c305b794bf797476c861939d1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:17Z,use_quota=True,user_id='e8d658a337574b1cba14fb26a384a0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0d9d3d-c4ac-4fb1-a44b-a7f7bbe01b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0d9d3d-c4ac-4fb1-a44b-a7f7bbe01b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70007d37-208f-4918-84d5-4f018efae6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70007d37-208f-4918-84d5-4f018efae6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e57f3de-8167-4878-8a79-1bb2741d88af', 'volume_name': 'volume-1e57f3de-8167-4878-8a79-1bb2741d88af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dc6a15-48b4-4371-a9c5-37f7e8a5ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dc6a15-48b4-4371-a9c5-37f7e8a5ae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b23397-6959-4eb2-9f7d-5ad4f8fe8ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Volume 1e57f3de-8167-4878-8a79-1bb2741d88af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e57f3de-8167-4878-8a79-1bb2741d88af', 'volume_size': 1} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-bd1ad5df-e371-44d6-9e74-8758fd4c6390 req-6c284c92-b55d-442e-bf0f-a78e6b3b8875 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.071s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2135775699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e57f3de-8167-4878-8a79-1bb2741d88af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9573c305b794bf797476c861939d1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:17Z,use_quota=True,user_id='e8d658a337574b1cba14fb26a384a0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Creating volume 1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:17 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:17 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af 1073741824 Sep 28 05:13:17 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-bd1ad5df-e371-44d6-9e74-8758fd4c6390 req-6c284c92-b55d-442e-bf0f-a78e6b3b8875 tempest-AttachVolumeTestJSON-547550533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-ad747e76-d285-442b-a428-1d201c118322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfa9e2e6-b7af-4a0b-b2c6-f67635892a11', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:13:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-bd1ad5df-e371-44d6-9e74-8758fd4c6390 req-6c284c92-b55d-442e-bf0f-a78e6b3b8875 tempest-AttachVolumeTestJSON-547550533 None] attachment_update completed successfully. Sep 28 05:13:18 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af 1073741824" returned: 0 in 0.763s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:18 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:18 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:18 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b23397-6959-4eb2-9f7d-5ad4f8fe8ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e57f3de-8167-4878-8a79-1bb2741d88af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f06898-e2bc-4386-a654-4c9f161618b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:18 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Volume volume-1e57f3de-8167-4878-8a79-1bb2741d88af (1e57f3de-8167-4878-8a79-1bb2741d88af): created successfully Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f06898-e2bc-4386-a654-4c9f161618b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Flow 'volume_create_manager' (1999ceec-5482-4eea-ba7c-618eb80c6741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ad1159e1-6bfb-439d-b40a-d6d180bff5a5 tempest-VolumesCloneTest-1060131486 None] Created volume successfully. Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Flow 'volume_create_manager' (98a38d6b-14e1-4701-b5f2-4469399213c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568ea18-7ac1-4eb0-8c9a-f264e7a3176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (beb3b51d-4848-46b3-a33d-7c1502a89b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549c4779-dc48-4856-8cf2-3f2455f92a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568ea18-7ac1-4eb0-8c9a-f264e7a3176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1535768321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35231d62-649a-4718-a1d4-393b93b51c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9573c305b794bf797476c861939d1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1e57f3de-8167-4878-8a79-1bb2741d88af,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:20Z,use_quota=True,user_id='e8d658a337574b1cba14fb26a384a0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944d374-6ee7-4e73-8ad6-7fb62c24aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944d374-6ee7-4e73-8ad6-7fb62c24aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c3d29-15de-4747-af21-c9c6c0c82286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c3d29-15de-4747-af21-c9c6c0c82286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '35231d62-649a-4718-a1d4-393b93b51c57', 'volume_name': 'volume-35231d62-649a-4718-a1d4-393b93b51c57', 'volume_size': 2, 'source_volid': '1e57f3de-8167-4878-8a79-1bb2741d88af', 'source_volstatus': 'available'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2353b350-f327-4880-8b5e-3fed002bd375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2353b350-f327-4880-8b5e-3fed002bd375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e181c82a-4608-4a35-950e-a9dddbc5d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Volume 35231d62-649a-4718-a1d4-393b93b51c57: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-35231d62-649a-4718-a1d4-393b93b51c57', 'volume_size': 2, 'source_volid': '1e57f3de-8167-4878-8a79-1bb2741d88af', 'source_volstatus': 'available'} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549c4779-dc48-4856-8cf2-3f2455f92a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-347493846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebfac46-0019-463b-8c1a-108c2fd8df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:20Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2ffe59-0419-4dd6-8d46-809648c2f1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2ffe59-0419-4dd6-8d46-809648c2f1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b557bf-ea58-4648-8b7e-4417b00c5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b557bf-ea58-4648-8b7e-4417b00c5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebfac46-0019-463b-8c1a-108c2fd8df27', 'volume_name': 'volume-8ebfac46-0019-463b-8c1a-108c2fd8df27', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be9b30d-5886-42b9-b29a-a99acd4ecce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be9b30d-5886-42b9-b29a-a99acd4ecce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5e4c10-8bc4-460b-910c-f269ef69b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Volume 8ebfac46-0019-463b-8c1a-108c2fd8df27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebfac46-0019-463b-8c1a-108c2fd8df27', 'volume_size': 1} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-347493846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebfac46-0019-463b-8c1a-108c2fd8df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b621f43569f74a68a1de04c5dae51934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:20Z,use_quota=True,user_id='c6b8e5e24417414b859ae30f1c557def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Creating volume 8ebfac46-0019-463b-8c1a-108c2fd8df27 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:20 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:20 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 1073741824 Sep 28 05:13:20 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:21 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 1073741824" returned: 0 in 0.598s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:21 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 Sep 28 05:13:21 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:21 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.906s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:21 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Cloning volume 1e57f3de-8167-4878-8a79-1bb2741d88af to volume 35231d62-649a-4718-a1d4-393b93b51c57 Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5e4c10-8bc4-460b-910c-f269ef69b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebfac46-0019-463b-8c1a-108c2fd8df27', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dcc24c-b345-4838-bf67-be70e1005e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Volume volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 (8ebfac46-0019-463b-8c1a-108c2fd8df27): created successfully Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dcc24c-b345-4838-bf67-be70e1005e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Flow 'volume_create_manager' (beb3b51d-4848-46b3-a33d-7c1502a89b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Creating offline snapshot e2b50459-7c46-4728-b3a5-fb8683f68e36 of volume 1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:13:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0c9dd1ed-8557-43ca-83ed-3a190a2759f1 tempest-AttachVolumeTestJSON-547550533 None] Created volume successfully. Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d104f-aef2-4df2-b595-d28fe0f818d5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:21 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:21 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:22 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:22 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 1G Sep 28 05:13:22 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:22 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 1G" returned: 0 in 0.578s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e57f3de-8167-4878-8a79-1bb2741d88af -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:22 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e57f3de-8167-4878-8a79-1bb2741d88af -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:22 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:23 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e57f3de-8167-4878-8a79-1bb2741d88af -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.393s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:23 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 is being set with open permissions: ugo+rw Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:23 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:23 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:23 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fd86d395-0b75-4dfb-8d5d-8e51e884e9c1 req-c06dde74-1012-4782-9689-8a1f78b68e77 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:23 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info Sep 28 05:13:23 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:23 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info" returned: 0 in 0.308s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:23 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info is being set with open permissions: ugo+rw Sep 28 05:13:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:23 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info Sep 28 05:13:23 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:24 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.info" returned: 0 in 0.337s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] snapshot: e2b50459-7c46-4728-b3a5-fb8683f68e36, volume: 35231d62-649a-4718-a1d4-393b93b51c57, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf34f70-81c2-4c30-8966-a8502a6a7bd5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:24 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:24 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:24 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.473s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e57f3de-8167-4878-8a79-1bb2741d88af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88d1ef-918a-4c95-8227-ea7c74df023e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:24 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:24 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:25 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.424s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:13:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:13:25 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:13:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:25 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 Sep 28 05:13:25 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Flow 'volume_create_manager' (216de65a-4287-4dc6-98f0-1733a637012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e3c186-88f9-4341-b217-42e282eeacad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e3c186-88f9-4341-b217-42e282eeacad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1956306338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eeb1db4-2330-43e2-bf42-f4534455db35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc0afa8188c48f7acb3b40fcd3bb290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:26Z,use_quota=True,user_id='b192e56464f54a1f9c05d55570764ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff45f000-bdb6-474d-8310-93795630f0d4),volume_type_id=ff45f000-bdb6-474d-8310-93795630f0d4)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25deac72-fdc5-41ce-aa78-204c9e154045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25deac72-fdc5-41ce-aa78-204c9e154045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046cf43-2b3e-4b94-a084-e2b2d5c6de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046cf43-2b3e-4b94-a084-e2b2d5c6de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eeb1db4-2330-43e2-bf42-f4534455db35', 'volume_name': 'volume-8eeb1db4-2330-43e2-bf42-f4534455db35', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dc21f8-88d1-4ca6-9782-f92c36e5fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dc21f8-88d1-4ca6-9782-f92c36e5fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe5e3d6-adf1-4cc9-bc74-20ce273c8fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Volume 8eeb1db4-2330-43e2-bf42-f4534455db35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eeb1db4-2330-43e2-bf42-f4534455db35', 'volume_size': 1} Sep 28 05:13:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:29 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:29 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:29 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.376s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:13:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:13:33 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57" returned: 0 in 7.995s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af, size 1024.00 MB, duration 8.00 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:13:33 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Converted 1024.00 MB image at 128.06 MB/s Sep 28 05:13:33 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 is being set with open permissions: ugo+rw Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:33 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 Sep 28 05:13:33 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:33 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" released by "_copy_volume_from_snapshot" :: held 9.266s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=99,cinder:UPDATE=115,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-quobyte-e2b50459-7c46-4728-b3a5-fb8683f68e36" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-e2b50459-7c46-4728-b3a5-fb8683f68e36" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Deleting offline snapshot e2b50459-7c46-4728-b3a5-fb8683f68e36 of volume 1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] snapshot_file for this snap is: volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea379fb-a686-4a3d-bf7e-4bc5f96b0a0d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:33 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:33 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:33 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e57f3de-8167-4878-8a79-1bb2741d88af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb06be6-723f-46ca-9c57-f72f6eec2063]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:34 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:34 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:34 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.566s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:34 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:34 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:34 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.435s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:35 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36 Sep 28 05:13:35 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:35 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af.e2b50459-7c46-4728-b3a5-fb8683f68e36" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-e2b50459-7c46-4728-b3a5-fb8683f68e36" released by "_delete_snapshot" :: held 1.775s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.736s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fd86d395-0b75-4dfb-8d5d-8e51e884e9c1 req-c06dde74-1012-4782-9689-8a1f78b68e77 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.886s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fd86d395-0b75-4dfb-8d5d-8e51e884e9c1 req-c06dde74-1012-4782-9689-8a1f78b68e77 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.191s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1956306338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eeb1db4-2330-43e2-bf42-f4534455db35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc0afa8188c48f7acb3b40fcd3bb290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:26Z,use_quota=True,user_id='b192e56464f54a1f9c05d55570764ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff45f000-bdb6-474d-8310-93795630f0d4),volume_type_id=ff45f000-bdb6-474d-8310-93795630f0d4)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Creating volume 8eeb1db4-2330-43e2-bf42-f4534455db35 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:35 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:35 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 1073741824 Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e181c82a-4608-4a35-950e-a9dddbc5d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35231d62-649a-4718-a1d4-393b93b51c57', 'volume_size': 2, 'source_volid': '1e57f3de-8167-4878-8a79-1bb2741d88af', 'source_volstatus': 'available'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:35 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b520c-065d-4135-b3c9-8828338ff19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:35 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Volume volume-35231d62-649a-4718-a1d4-393b93b51c57 (35231d62-649a-4718-a1d4-393b93b51c57): created successfully Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b520c-065d-4135-b3c9-8828338ff19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Flow 'volume_create_manager' (98a38d6b-14e1-4701-b5f2-4469399213c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-fd86d395-0b75-4dfb-8d5d-8e51e884e9c1 req-c06dde74-1012-4782-9689-8a1f78b68e77 tempest-AttachVolumeTestJSON-547550533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-8ebfac46-0019-463b-8c1a-108c2fd8df27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac4d92b0-5969-4fac-bedc-e891ec9a4495', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:13:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6e1f2000-8efe-4efd-b18a-715bf17814e5 tempest-VolumesCloneTest-1060131486 None] Created volume successfully. Sep 28 05:13:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-fd86d395-0b75-4dfb-8d5d-8e51e884e9c1 req-c06dde74-1012-4782-9689-8a1f78b68e77 tempest-AttachVolumeTestJSON-547550533 None] attachment_update completed successfully. Sep 28 05:13:35 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 1073741824" returned: 0 in 0.582s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:36 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 Sep 28 05:13:36 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:36 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35" returned: 0 in 0.326s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe5e3d6-adf1-4cc9-bc74-20ce273c8fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eeb1db4-2330-43e2-bf42-f4534455db35', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7618c8a7-1409-49c9-8174-c7bf3b313df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:36 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Volume volume-8eeb1db4-2330-43e2-bf42-f4534455db35 (8eeb1db4-2330-43e2-bf42-f4534455db35): created successfully Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7618c8a7-1409-49c9-8174-c7bf3b313df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Flow 'volume_create_manager' (216de65a-4287-4dc6-98f0-1733a637012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-042b5932-aab6-424e-b219-9a11ebd897a8 tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Created volume successfully. Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-35231d62-649a-4718-a1d4-393b93b51c57-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-35231d62-649a-4718-a1d4-393b93b51c57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e1892-3ad2-460e-81d0-425a46322ad7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:36 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 Sep 28 05:13:36 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:37 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57" returned: 0 in 0.488s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:37 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57 Sep 28 05:13:37 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:37 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35231d62-649a-4718-a1d4-393b93b51c57" returned: 0 in 0.447s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-35231d62-649a-4718-a1d4-393b93b51c57" released by "delete_volume" :: held 1.004s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Created reservations ['5f5b0508-ef68-4c69-96ec-a981f5cca74e', 'df6a8570-b1d5-4f78-ad0e-c09f6f161a69', '604998b3-39a3-4bf8-bf53-6a3e1e7067c7', '7f1d0618-fbea-4f6e-823f-d1d02fc4d923'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:37 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:37 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:38 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:38 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:38 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.327s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8a0b1f50-700d-4d9f-9f18-2bda87d8a32d tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Retype volume completed successfully. Sep 28 05:13:38 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.327s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Deleted volume successfully. Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4b1d51b2-d828-40c0-973b-0f2c1ace8fc3 tempest-VolumesCloneTest-1060131486 None] Lock "cinder-35231d62-649a-4718-a1d4-393b93b51c57-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-91233508-a0d4-428b-81a1-ea7c2c449735 req-0e4595c9-1f7e-487c-91a0-cc479072dd47 tempest-AttachVolumeTestJSON-547550533 None] Terminate volume connection completed successfully. Sep 28 05:13:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-91233508-a0d4-428b-81a1-ea7c2c449735 req-0e4595c9-1f7e-487c-91a0-cc479072dd47 tempest-AttachVolumeTestJSON-547550533 None] Deleting attachment cfa9e2e6-b7af-4a0b-b2c6-f67635892a11. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-1e57f3de-8167-4878-8a79-1bb2741d88af-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "cinder-1e57f3de-8167-4878-8a79-1bb2741d88af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Acquiring lock "cinder-quobyte-1e57f3de-8167-4878-8a79-1bb2741d88af" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-1e57f3de-8167-4878-8a79-1bb2741d88af" acquired by "delete_volume" :: waited 0.048s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "cinder-8eeb1db4-2330-43e2-bf42-f4534455db35-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1ff160-74ca-4f26-89eb-ab1bbcc646af]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "cinder-8eeb1db4-2330-43e2-bf42-f4534455db35-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "cinder-quobyte-8eeb1db4-2330-43e2-bf42-f4534455db35" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "cinder-quobyte-8eeb1db4-2330-43e2-bf42-f4534455db35" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[630e8970-0696-4efc-a02b-42e2464d7b5a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:39 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:39 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:39 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 Sep 28 05:13:39 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:39 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.523s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:39 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af Sep 28 05:13:39 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:39 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35" returned: 0 in 0.536s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:39 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35 Sep 28 05:13:39 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:40 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1e57f3de-8167-4878-8a79-1bb2741d88af" returned: 0 in 0.344s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "cinder-quobyte-1e57f3de-8167-4878-8a79-1bb2741d88af" released by "delete_volume" :: held 1.008s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-8f6f1668-5fdb-47d6-9a61-235f72a70325 req-dbd7bdf8-d558-4cc4-935e-ea9628b0f92c tempest-AttachVolumeTestJSON-547550533 None] Terminate volume connection completed successfully. Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-8f6f1668-5fdb-47d6-9a61-235f72a70325 req-dbd7bdf8-d558-4cc4-935e-ea9628b0f92c tempest-AttachVolumeTestJSON-547550533 None] Deleting attachment ac4d92b0-5969-4fac-bedc-e891ec9a4495. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Created reservations ['dd81530e-fb6f-4a8a-9539-68720c43facb', '89b18bff-0164-4b47-ba2b-9af6bd58097e', '68fe538b-e8a0-48b6-a398-140cc4c0dc7c', '87d9cf94-1ef9-45f5-8707-09858b9e4537'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:40 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8eeb1db4-2330-43e2-bf42-f4534455db35" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "cinder-quobyte-8eeb1db4-2330-43e2-bf42-f4534455db35" released by "delete_volume" :: held 0.967s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:40 devstack cinder-volume[86815]: WARNING cinder.quota [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:13:40 devstack cinder-volume[86815]: WARNING cinder.quota [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:40 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:40 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Created reservations ['7eb432d7-6b28-41c6-ae16-4c79a08e4a0f', 'c8f5a450-e391-4262-b6ae-9374653639d1', 'ba24271a-fd35-4924-8421-ce02a1c77575', '8ffed10b-0ddf-4564-8b34-1eedc1dfd243'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:40 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:40 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:40 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.344s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Deleted volume successfully. Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-102c5375-2a6f-47cb-9cdc-b9db39ed0cae tempest-VolumesCloneTest-1060131486 None] Lock "cinder-1e57f3de-8167-4878-8a79-1bb2741d88af-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:40 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.315s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Deleted volume successfully. Sep 28 05:13:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-afa51bce-53ef-4d5a-bfd5-6513715d3b8e tempest-VolumeRetypeWithoutMigrationTest-1885663346 None] Lock "cinder-8eeb1db4-2330-43e2-bf42-f4534455db35-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-8ebfac46-0019-463b-8c1a-108c2fd8df27-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-8ebfac46-0019-463b-8c1a-108c2fd8df27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-quobyte-8ebfac46-0019-463b-8c1a-108c2fd8df27" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-8ebfac46-0019-463b-8c1a-108c2fd8df27" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ce431-052c-4ddc-822e-0a8094d9e1ab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:46 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 Sep 28 05:13:46 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:46 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27" returned: 0 in 0.693s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:46 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27 Sep 28 05:13:46 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:47 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8ebfac46-0019-463b-8c1a-108c2fd8df27" returned: 0 in 0.501s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-8ebfac46-0019-463b-8c1a-108c2fd8df27" released by "delete_volume" :: held 1.263s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Created reservations ['dc71fcfe-f7d8-4b9f-8f82-180f56d5e9ed', 'bb59d4ec-6a63-4795-9bb5-7f8d9d3e33f2', '76d711ac-faee-4b39-b8e4-eb9c8e7987b9', '41414688-5490-463d-aa45-aab684f81987'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:47 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:47 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Flow 'volume_create_manager' (df2589d0-6518-4544-9ccd-ea5b746f9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd3159d-17ff-4581-a6c3-133bbc333449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:48 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd3159d-17ff-4581-a6c3-133bbc333449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1830656694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbef60b4-3d56-4505-89a3-fc171b9bc7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf392239ee343dcade74496f0d06e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:48Z,use_quota=True,user_id='139396bee69947c4bc314c03c3fb1d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8479282a-5321-44ba-8f87-f7dd43dc3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8479282a-5321-44ba-8f87-f7dd43dc3301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e4f02f-4e3b-4cda-8a57-ccc4bdbfdc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e4f02f-4e3b-4cda-8a57-ccc4bdbfdc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbef60b4-3d56-4505-89a3-fc171b9bc7d7', 'volume_name': 'volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7', 'volume_size': 2}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84af1f35-3322-43bb-a77b-06947b470a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84af1f35-3322-43bb-a77b-06947b470a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0806d949-ff80-45a6-8c1e-a5bb554928df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:48 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Volume dbef60b4-3d56-4505-89a3-fc171b9bc7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7', 'volume_size': 2} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1830656694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbef60b4-3d56-4505-89a3-fc171b9bc7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf392239ee343dcade74496f0d06e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:48Z,use_quota=True,user_id='139396bee69947c4bc314c03c3fb1d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Creating volume dbef60b4-3d56-4505-89a3-fc171b9bc7d7 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:48 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 2147483648 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.571s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Deleted volume successfully. Sep 28 05:13:48 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 2147483648 Sep 28 05:13:48 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9f078b23-d005-422c-8eb4-5f1b2b537428 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-8ebfac46-0019-463b-8c1a-108c2fd8df27-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-ad747e76-d285-442b-a428-1d201c118322-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-ad747e76-d285-442b-a428-1d201c118322-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-quobyte-ad747e76-d285-442b-a428-1d201c118322" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-ad747e76-d285-442b-a428-1d201c118322" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1d4f3-4dff-452a-87d5-e133676c6296]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:48 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 Sep 28 05:13:48 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:48 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 2147483648" returned: 0 in 0.642s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:48 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 Sep 28 05:13:48 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:49 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322" returned: 0 in 0.552s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:49 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322 Sep 28 05:13:49 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:49 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0806d949-ff80-45a6-8c1e-a5bb554928df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7', 'volume_size': 2}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5620ad-8c61-443e-8bba-3a940f98751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:49 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Volume volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 (dbef60b4-3d56-4505-89a3-fc171b9bc7d7): created successfully Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5620ad-8c61-443e-8bba-3a940f98751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Flow 'volume_create_manager' (df2589d0-6518-4544-9ccd-ea5b746f9232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2deff17a-1f64-4030-afdf-c473b58116d7 tempest-VolumesCloneNegativeTest-665829452 None] Created volume successfully. Sep 28 05:13:49 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad747e76-d285-442b-a428-1d201c118322" returned: 0 in 0.389s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-ad747e76-d285-442b-a428-1d201c118322" released by "delete_volume" :: held 0.992s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Created reservations ['15be3c49-7b07-4055-bb41-361cdac925f5', '503346c5-72b6-425c-bcd1-bcd4762da939', '74ddc52e-137f-41c8-a42f-570beab04d38', '320bca6c-ec37-4224-8668-97f8eb8dd84c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:49 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:49 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:49 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.269s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Deleted volume successfully. Sep 28 05:13:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dddb1038-7ae5-4b8a-aa4a-2214dcf75065 tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-ad747e76-d285-442b-a428-1d201c118322-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Acquiring lock "cinder-dbef60b4-3d56-4505-89a3-fc171b9bc7d7-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "cinder-dbef60b4-3d56-4505-89a3-fc171b9bc7d7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Acquiring lock "cinder-quobyte-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "cinder-quobyte-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" acquired by "delete_volume" :: waited 0.055s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b1094b-6a72-4c41-ba0a-d851971970fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-125e4d65-a137-4221-99ab-a033db453585-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-125e4d65-a137-4221-99ab-a033db453585-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "cinder-quobyte-125e4d65-a137-4221-99ab-a033db453585" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-125e4d65-a137-4221-99ab-a033db453585" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:51 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 Sep 28 05:13:51 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f8aac6-f39d-4189-bd95-edd68ccdb71c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:51 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 Sep 28 05:13:51 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Flow 'volume_create_manager' (83c26437-c989-4e60-a9e6-a04926e76493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268b810c-f265-4a6d-b17d-78c98c23aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268b810c-f265-4a6d-b17d-78c98c23aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-699826543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbff2310-cca8-4a07-98d9-f139fbb28063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7881a34913541c3b175ae85bbd323b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:52Z,use_quota=True,user_id='1f56add66ca640ad829c812ba1359e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:51 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e24e7-d321-4a80-8299-198539883d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674e24e7-d321-4a80-8299-198539883d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8bc379-d6d2-4242-9945-445cdefca929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8bc379-d6d2-4242-9945-445cdefca929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbff2310-cca8-4a07-98d9-f139fbb28063', 'volume_name': 'volume-cbff2310-cca8-4a07-98d9-f139fbb28063', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4d1aee-4b97-43ae-935e-73dbdf1e8496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4d1aee-4b97-43ae-935e-73dbdf1e8496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfce0e01-675d-46d1-9922-2a73eb8ec326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Volume cbff2310-cca8-4a07-98d9-f139fbb28063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbff2310-cca8-4a07-98d9-f139fbb28063', 'volume_size': 1} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-699826543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbff2310-cca8-4a07-98d9-f139fbb28063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7881a34913541c3b175ae85bbd323b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:13:52Z,use_quota=True,user_id='1f56add66ca640ad829c812ba1359e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Creating volume cbff2310-cca8-4a07-98d9-f139fbb28063 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:13:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" returned: 0 in 1.020s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:51 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 1073741824 Sep 28 05:13:51 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:51 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:51 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7 Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585" returned: 0 in 0.800s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:51 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:52 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585 Sep 28 05:13:52 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:52 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "cinder-quobyte-dbef60b4-3d56-4505-89a3-fc171b9bc7d7" released by "delete_volume" :: held 1.658s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-125e4d65-a137-4221-99ab-a033db453585" returned: 0 in 0.459s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-quobyte-125e4d65-a137-4221-99ab-a033db453585" released by "delete_volume" :: held 1.394s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:52 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 1073741824" returned: 0 in 0.689s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Created reservations ['ff2a9d91-59a4-4c86-a157-eb25283bcd75', '5f46d0f4-d5b3-4c78-a3c2-1bd76bba8797', 'a54e257c-3a9c-42af-901d-d59bdd4e8026', 'e702f0f1-4069-4109-8a83-da0a2a24a14f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Created reservations ['93f8b963-3f17-42df-8001-4c76296595ee', '5bb2ab1a-1840-41cc-8581-b714a6f6f9ac', '9d5c732f-fdb9-43f3-abcd-2bf1bd9a98f6', 'ae2a613a-d6e8-4a1e-83ec-997488a9e6f9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:52 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 Sep 28 05:13:52 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:52 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:52 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:52 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:52 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:52 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063" returned: 0 in 0.298s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfce0e01-675d-46d1-9922-2a73eb8ec326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbff2310-cca8-4a07-98d9-f139fbb28063', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36e4e10-8e91-4dad-a56c-29d10f111fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:13:52 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.280s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Volume volume-cbff2310-cca8-4a07-98d9-f139fbb28063 (cbff2310-cca8-4a07-98d9-f139fbb28063): created successfully Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36e4e10-8e91-4dad-a56c-29d10f111fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Flow 'volume_create_manager' (83c26437-c989-4e60-a9e6-a04926e76493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:13:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Deleted volume successfully. Sep 28 05:13:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8485e356-a34a-4706-9881-978817fbcfec tempest-VolumesServicesTestJSON-190413454 None] Created volume successfully. Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd3b9ce3-04e5-4b97-b6d5-88f2109984f0 tempest-VolumesCloneNegativeTest-665829452 None] Lock "cinder-dbef60b4-3d56-4505-89a3-fc171b9bc7d7-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:52 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Deleted volume successfully. Sep 28 05:13:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-dd084847-343c-4ad4-aeb0-28b87188a1ee tempest-AttachVolumeTestJSON-547550533 None] Lock "cinder-125e4d65-a137-4221-99ab-a033db453585-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Acquiring lock "cinder-cbff2310-cca8-4a07-98d9-f139fbb28063-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "cinder-cbff2310-cca8-4a07-98d9-f139fbb28063-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Acquiring lock "cinder-quobyte-cbff2310-cca8-4a07-98d9-f139fbb28063" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "cinder-quobyte-cbff2310-cca8-4a07-98d9-f139fbb28063" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64713a7f-6ab0-4e54-9812-ff219acdc44e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:54 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 Sep 28 05:13:54 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:54 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063" returned: 0 in 0.511s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:54 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063 Sep 28 05:13:54 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:55 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cbff2310-cca8-4a07-98d9-f139fbb28063" returned: 0 in 0.473s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "cinder-quobyte-cbff2310-cca8-4a07-98d9-f139fbb28063" released by "delete_volume" :: held 1.054s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Created reservations ['9deb644d-6a34-4875-8293-b330be97299b', 'b3e1daaa-d3a1-4c78-9e6d-15b4b2a4d564', '1d785a8d-1dc4-49e7-89fc-eb3f35dc213d', '9f316683-f3c6-4b1c-9514-0764bfd16bb2'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:13:55 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:13:55 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:13:55 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.446s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:13:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Deleted volume successfully. Sep 28 05:13:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b3de8ed-877f-49a4-9c36-012f41eac2c5 tempest-VolumesServicesTestJSON-190413454 None] Lock "cinder-cbff2310-cca8-4a07-98d9-f139fbb28063-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:05 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=75,cinder:SELECT=63,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:14:05 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:INSERT=25,cinder:UPDATE=102,cinder:SELECT=75,cinder:DELETE=9 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:14:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d159a97d-805c-4a99-9d55-248dafa37f39 tempest-GroupsV314Test-1425179726 None] Group tempest-GroupsV314Test-Group-1150582457: creating Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Flow 'volume_create_manager' (d0b79123-b4c4-42f4-a5ce-b11837ceaf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce94762-8873-484a-a2fa-23cf7e643172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce94762-8873-484a-a2fa-23cf7e643172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-249396191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660ab0d1-f5e6-417f-9ea3-93a8b8f761d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691037ef757c4825a30253de8cb3f304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:08Z,use_quota=True,user_id='e8968aa52a104a349abd2815e3d21be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0047e5-a550-49a9-9bc3-9b508d7f1a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0047e5-a550-49a9-9bc3-9b508d7f1a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710899f1-7c05-489e-b41f-b025f9ec0efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710899f1-7c05-489e-b41f-b025f9ec0efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660ab0d1-f5e6-417f-9ea3-93a8b8f761d6', 'volume_name': 'volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dfdb5b-455e-4c09-ba55-bb6ca92e9970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dfdb5b-455e-4c09-ba55-bb6ca92e9970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc8978-602e-4279-b356-3559a5c0ac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Volume 660ab0d1-f5e6-417f-9ea3-93a8b8f761d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6', 'volume_size': 1} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-249396191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660ab0d1-f5e6-417f-9ea3-93a8b8f761d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691037ef757c4825a30253de8cb3f304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:08Z,use_quota=True,user_id='e8968aa52a104a349abd2815e3d21be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Creating volume 660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:07 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d159a97d-805c-4a99-9d55-248dafa37f39 tempest-GroupsV314Test-1425179726 None] Group tempest-GroupsV314Test-Group-1150582457: created successfully Sep 28 05:14:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d159a97d-805c-4a99-9d55-248dafa37f39 tempest-GroupsV314Test-1425179726 None] Create group completed successfully. Sep 28 05:14:07 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 1073741824 Sep 28 05:14:07 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:08 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 1073741824" returned: 0 in 0.524s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:08 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 Sep 28 05:14:08 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:08 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" returned: 0 in 0.312s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbc8978-602e-4279-b356-3559a5c0ac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267bb0b3-d258-4f4d-96a9-1207f26a63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Volume volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 (660ab0d1-f5e6-417f-9ea3-93a8b8f761d6): created successfully Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267bb0b3-d258-4f4d-96a9-1207f26a63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Flow 'volume_create_manager' (d0b79123-b4c4-42f4-a5ce-b11837ceaf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-87fd6cfe-deda-4d23-84ae-660c01f3afa0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Created volume successfully. Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Flow 'volume_create_manager' (246b7681-dd2b-4505-befd-e1ea5822b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86da6c38-c5e3-4898-8290-bc1a98c7065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86da6c38-c5e3-4898-8290-bc1a98c7065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131491838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2545bd95-ebf5-45fa-852b-bbf7fb904e51,host='devstack@QuobyteHD#QuobyteHD',id=4d39c789-fe11-40c5-89ad-00a48db4201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efdcc3bd70a47e695b0b00d7575ed9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:09Z,use_quota=True,user_id='b2073f8ab7f64dc48eb5da1c72f3d185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5eb8f7-bda2-4b66-b4ea-60a10db5ddbf),volume_type_id=0b5eb8f7-bda2-4b66-b4ea-60a10db5ddbf)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26d770e-f1c4-43ab-97ab-ebe959a71765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26d770e-f1c4-43ab-97ab-ebe959a71765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb312614-b513-481d-aac5-82d84740b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb312614-b513-481d-aac5-82d84740b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d39c789-fe11-40c5-89ad-00a48db4201c', 'volume_name': 'volume-4d39c789-fe11-40c5-89ad-00a48db4201c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86158e16-59f1-4582-b1b4-6c5c0fbe4b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86158e16-59f1-4582-b1b4-6c5c0fbe4b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a1324d-ffb1-4294-8f0d-782ebc2ed370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Volume 4d39c789-fe11-40c5-89ad-00a48db4201c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d39c789-fe11-40c5-89ad-00a48db4201c', 'volume_size': 1} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2545bd95-ebf5-45fa-852b-bbf7fb904e51,created_at=2026-09-28T03:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131491838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2545bd95-ebf5-45fa-852b-bbf7fb904e51,host='devstack@QuobyteHD#QuobyteHD',id=4d39c789-fe11-40c5-89ad-00a48db4201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efdcc3bd70a47e695b0b00d7575ed9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:09Z,use_quota=True,user_id='b2073f8ab7f64dc48eb5da1c72f3d185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5eb8f7-bda2-4b66-b4ea-60a10db5ddbf),volume_type_id=0b5eb8f7-bda2-4b66-b4ea-60a10db5ddbf)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Creating volume 4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:09 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:09 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c 1073741824 Sep 28 05:14:09 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:09 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c 1073741824" returned: 0 in 0.520s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:10 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:10 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:10 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.268s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.351s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a1324d-ffb1-4294-8f0d-782ebc2ed370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d39c789-fe11-40c5-89ad-00a48db4201c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c5b809-5d2b-4a9c-a3e3-bc6adaefc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Creating offline snapshot a8ca48d5-088d-496b-9a39-0b3035226cb6 of volume 660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:14:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Volume volume-4d39c789-fe11-40c5-89ad-00a48db4201c (4d39c789-fe11-40c5-89ad-00a48db4201c): created successfully Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c5b809-5d2b-4a9c-a3e3-bc6adaefc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Flow 'volume_create_manager' (246b7681-dd2b-4505-befd-e1ea5822b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cef777-f2e6-4730-bc0b-0cd18df091fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-45fa0fa8-2e12-4d27-b6a3-aacca84615b3 tempest-GroupsV314Test-1425179726 None] Created volume successfully. Sep 28 05:14:10 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 Sep 28 05:14:10 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (590b709f-f351-4871-b187-53856821efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91148ffa-6cba-4bd1-9edf-18c93186a501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91148ffa-6cba-4bd1-9edf-18c93186a501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304814873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b592573-4643-47e2-b9fc-a1af38120058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:11Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c70bbf4-7346-4ba5-8ba5-7fa98beff3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c70bbf4-7346-4ba5-8ba5-7fa98beff3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd10075-e99f-4364-8a0c-7a7faf059fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd10075-e99f-4364-8a0c-7a7faf059fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b592573-4643-47e2-b9fc-a1af38120058', 'volume_name': 'volume-7b592573-4643-47e2-b9fc-a1af38120058', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6002790-9d58-44b9-91f2-2a7a355c7ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6002790-9d58-44b9-91f2-2a7a355c7ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d75c1b6-8482-4688-a971-27b292f38a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Volume 7b592573-4643-47e2-b9fc-a1af38120058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b592573-4643-47e2-b9fc-a1af38120058', 'volume_size': 1} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:10 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" returned: 0 in 0.425s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:10 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 1G Sep 28 05:14:10 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:11 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 1G" returned: 0 in 0.436s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:11 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 Sep 28 05:14:11 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:11 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:11 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 is being set with open permissions: ugo+rw Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:11 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 Sep 28 05:14:11 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:11 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:11 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info Sep 28 05:14:11 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:12 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:12 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info is being set with open permissions: ugo+rw Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:12 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info Sep 28 05:14:12 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:12 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.info" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304814873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b592573-4643-47e2-b9fc-a1af38120058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:11Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Creating volume 7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:12 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:12 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 1073741824 Sep 28 05:14:12 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6d967d31-5b25-4e46-a73e-49fe4dcfe6d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Create snapshot completed successfully Sep 28 05:14:12 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 1073741824" returned: 0 in 0.478s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:12 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 Sep 28 05:14:12 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:13 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058" returned: 0 in 0.290s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Cloning volume 4d39c789-fe11-40c5-89ad-00a48db4201c to volume 25162cc7-b813-4ca2-9fa6-b695ea9eca5d Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d75c1b6-8482-4688-a971-27b292f38a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b592573-4643-47e2-b9fc-a1af38120058', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d08225a-ec09-4661-8348-40ad87ef8880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Volume volume-7b592573-4643-47e2-b9fc-a1af38120058 (7b592573-4643-47e2-b9fc-a1af38120058): created successfully Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d08225a-ec09-4661-8348-40ad87ef8880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (590b709f-f351-4871-b187-53856821efbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Creating offline snapshot 7029f301-1be3-4db9-973c-fdc542eb487e of volume 4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:14:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bba59a54-a9a6-4362-be0b-37a4698fef34 tempest-VolumesSnapshotTestJSON-504785076 None] Created volume successfully. Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f857c9d-0b76-4b02-b935-842ca661f1be]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:13 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:13 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "cinder-a8ca48d5-088d-496b-9a39-0b3035226cb6-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-a8ca48d5-088d-496b-9a39-0b3035226cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "cinder-quobyte-a8ca48d5-088d-496b-9a39-0b3035226cb6" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-a8ca48d5-088d-496b-9a39-0b3035226cb6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Deleting offline snapshot a8ca48d5-088d-496b-9a39-0b3035226cb6 of volume 660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] snapshot_file for this snap is: volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[181cadfe-c55e-4b34-9587-33f1f67e7f1e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:13 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.407s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:13 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 Sep 28 05:14:13 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:13 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e 1G Sep 28 05:14:13 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6" returned: 0 in 0.459s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ee0d3-bdb5-44e4-8011-6bc815358924]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:14 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e 1G" returned: 0 in 0.506s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d39c789-fe11-40c5-89ad-00a48db4201c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 Sep 28 05:14:14 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d39c789-fe11-40c5-89ad-00a48db4201c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:14 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" returned: 0 in 0.388s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d39c789-fe11-40c5-89ad-00a48db4201c -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.296s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 Sep 28 05:14:14 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:14 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info Sep 28 05:14:14 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:14 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:14 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6 Sep 28 05:14:14 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:15 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info" returned: 0 in 0.262s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:15 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:15 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info Sep 28 05:14:15 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:15 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6.a8ca48d5-088d-496b-9a39-0b3035226cb6" returned: 0 in 0.280s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-a8ca48d5-088d-496b-9a39-0b3035226cb6" released by "_delete_snapshot" :: held 1.638s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" released by "delete_snapshot" :: held 1.660s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Created reservations ['df68a2de-b5c4-418d-bcff-fa541ba0fabf', '173695fc-afea-4879-bc5d-0d1e4d0c6d0a', '53841ea7-4aa5-4a4d-a4cc-1e25bcb372a4', 'c7914b7b-9465-49e0-b24c-bf0d57779b2b'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Delete snapshot completed successfully. Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d0c26b5-a790-468d-bde5-e1795e0b9f86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-a8ca48d5-088d-496b-9a39-0b3035226cb6-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:15 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.info" returned: 0 in 0.280s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Acquiring lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] snapshot: 7029f301-1be3-4db9-973c-fdc542eb487e, volume: 25162cc7-b813-4ca2-9fa6-b695ea9eca5d, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee40839-335a-4a82-8177-331b1e48e4a6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:15 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:15 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "cinder-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:15 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d39c789-fe11-40c5-89ad-00a48db4201c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12cb5eb-8b4f-42fe-ad32-06be142d8764]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659a971-ead4-4e8e-9a50-8018200a7d39]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:15 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 Sep 28 05:14:15 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:15 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:15 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:16 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" returned: 0 in 0.396s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:16 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.396s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:16 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6 Sep 28 05:14:16 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:16 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d Sep 28 05:14:16 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:16 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-quobyte-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6" released by "delete_volume" :: held 0.724s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Created reservations ['b8b4cbd9-7956-4cc2-bf66-6b3f4f130721', 'af04647e-0ef0-40e9-abcc-9412dfb34a23', 'f14120ce-7e9c-4f7a-b6e3-e819fb1928cc', 'fa6d0cb3-3285-4061-94e9-7fa807894e66'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:16 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:16 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:17 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:17 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Deleted volume successfully. Sep 28 05:14:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2aea8524-2d87-4492-803f-9f57d374a5a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1523569086 None] Lock "cinder-660ab0d1-f5e6-417f-9ea3-93a8b8f761d6-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:18 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Flow 'volume_create_manager' (321b82a1-538c-42d3-a18c-fc6a13aa6417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fc1e9d-51c4-4529-90fc-b46d2b2bff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fc1e9d-51c4-4529-90fc-b46d2b2bff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-275442452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3056cd-38f2-4189-81f9-7d761674c5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325d6fdc596549868f93abf5c2d0155b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:19Z,use_quota=True,user_id='5e02f718e64d47ef9a92a568f3ec982a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0116a951-4318-4004-96cc-2172e3297c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0116a951-4318-4004-96cc-2172e3297c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6705a6d-2536-4d98-a240-f1242beac56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6705a6d-2536-4d98-a240-f1242beac56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3056cd-38f2-4189-81f9-7d761674c5a9', 'volume_name': 'volume-ce3056cd-38f2-4189-81f9-7d761674c5a9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678823ee-6da8-46d3-8951-6b289e800604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678823ee-6da8-46d3-8951-6b289e800604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f89f9f-85c0-493c-b3d3-c3a074c66055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Volume ce3056cd-38f2-4189-81f9-7d761674c5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3056cd-38f2-4189-81f9-7d761674c5a9', 'volume_size': 1} Sep 28 05:14:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:23 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" returned: 0 in 7.702s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:23 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:14:23 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Converted 1024.00 MB image at 132.94 MB/s Sep 28 05:14:23 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 05:14:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:24 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d Sep 28 05:14:24 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:24 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" released by "_copy_volume_from_snapshot" :: held 8.836s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Acquiring lock "cinder-quobyte-7029f301-1be3-4db9-973c-fdc542eb487e" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-7029f301-1be3-4db9-973c-fdc542eb487e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Deleting offline snapshot 7029f301-1be3-4db9-973c-fdc542eb487e of volume 4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] snapshot_file for this snap is: volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e916b-ef53-4576-a5b4-6c0485fd53ae]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:24 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:24 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:24 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.392s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d39c789-fe11-40c5-89ad-00a48db4201c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f660bb3-8503-4465-8ab9-75534cdfd6f7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:24 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:24 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:25 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:25 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:25 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:25 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:25 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e Sep 28 05:14:25 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:25 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c.7029f301-1be3-4db9-973c-fdc542eb487e" returned: 0 in 0.269s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-7029f301-1be3-4db9-973c-fdc542eb487e" released by "_delete_snapshot" :: held 1.667s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.750s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.803s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Creating offline snapshot e98c1ac0-f043-4a86-8f2a-82d96dda0fae of volume 7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f813747c-35d7-4d14-abd3-67f3cd515d02]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:26 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a15085fe-43d5-4948-b5f0-652a58220c90 tempest-GroupsV314Test-1425179726 None] Create group from source-group-2545bd95-ebf5-45fa-852b-bbf7fb904e51 completed successfully. Sep 28 05:14:26 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 Sep 28 05:14:26 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:26 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058" returned: 0 in 0.425s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:26 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae 1G Sep 28 05:14:26 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Acquiring lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Flow 'volume_create_manager' (66e3733f-5f28-4ee2-a8b8-de4ade1fd92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cab21b3-bacc-41c8-8309-f72748f49c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" acquired by "delete_volume" :: waited 0.073s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cab21b3-bacc-41c8-8309-f72748f49c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1868831885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80559aa8-41f9-43fa-94f7-bb1c40736860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600c6bbbc17145569b3dff2affaa452f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:27Z,use_quota=True,user_id='93b9f73cb44b4aa2a2a886d06e37d5f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5462d05-32b7-4a99-becf-a5e5853c3fc6),volume_type_id=a5462d05-32b7-4a99-becf-a5e5853c3fc6)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c67496-fcad-420d-8ec9-064aab73a511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c67496-fcad-420d-8ec9-064aab73a511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb06af2-39c4-421e-8a5d-45bc17810c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb06af2-39c4-421e-8a5d-45bc17810c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80559aa8-41f9-43fa-94f7-bb1c40736860', 'volume_name': 'volume-80559aa8-41f9-43fa-94f7-bb1c40736860', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e08d0d-8cd6-453c-b405-b05d84ca1a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e08d0d-8cd6-453c-b405-b05d84ca1a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfea5166-e902-4369-b1f7-9b71f95d8eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Volume 80559aa8-41f9-43fa-94f7-bb1c40736860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80559aa8-41f9-43fa-94f7-bb1c40736860', 'volume_size': 1} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c435b-0f2c-4b17-83b0-e932849b72ba]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:26 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae 1G" returned: 0 in 0.464s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b592573-4643-47e2-b9fc-a1af38120058 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:26 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d Sep 28 05:14:26 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:26 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b592573-4643-47e2-b9fc-a1af38120058 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae Sep 28 05:14:26 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:27 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" returned: 0 in 0.375s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:27 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:27 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b592573-4643-47e2-b9fc-a1af38120058 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae" returned: 0 in 0.302s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:27 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:27 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae is being set with open permissions: ugo+rw Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:27 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae Sep 28 05:14:27 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:27 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" returned: 0 in 0.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:27 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-25162cc7-b813-4ca2-9fa6-b695ea9eca5d" released by "delete_volume" :: held 0.741s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:27 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info Sep 28 05:14:27 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Created reservations ['bf6497e8-a169-4a9c-bde8-24c49d99c593'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:27 devstack cinder-volume[86815]: WARNING cinder.quota [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-902649826 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-902649826, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:14:27 devstack cinder-volume[86815]: WARNING cinder.quota [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-902649826 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-902649826, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Created reservations ['70eee2d2-d2ef-4ba8-afe8-470e7253cc08', '62a6c518-8e5f-475e-8535-2a393227ee09', '251e5a19-98e9-4d53-a27f-f7cc3d0d41ec', '0fe680a1-fa9d-44b6-a577-a87580ae0901'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:27 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:27 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:27 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:27 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info is being set with open permissions: ugo+rw Sep 28 05:14:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:27 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info Sep 28 05:14:27 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-653eedbb-b808-48c3-8a3d-6e3ed416f5b9 tempest-GroupsV314Test-1425179726 None] Delete group completed successfully. Sep 28 05:14:28 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.info" returned: 0 in 0.277s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.973s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-275442452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3056cd-38f2-4189-81f9-7d761674c5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325d6fdc596549868f93abf5c2d0155b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:19Z,use_quota=True,user_id='5e02f718e64d47ef9a92a568f3ec982a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Creating volume ce3056cd-38f2-4189-81f9-7d761674c5a9 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:28 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 1073741824 Sep 28 05:14:28 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Acquiring lock "cinder-quobyte-4d39c789-fe11-40c5-89ad-00a48db4201c" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-4d39c789-fe11-40c5-89ad-00a48db4201c" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1f12d-74bb-451b-9125-876f261f3bd2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8ea4a0cd-717c-4420-8f68-81ba9efb6cfa tempest-VolumesSnapshotTestJSON-504785076 None] Create snapshot completed successfully Sep 28 05:14:28 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:28 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 1073741824" returned: 0 in 0.445s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:28 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 Sep 28 05:14:28 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.421s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:28 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c Sep 28 05:14:28 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1868831885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80559aa8-41f9-43fa-94f7-bb1c40736860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600c6bbbc17145569b3dff2affaa452f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:27Z,use_quota=True,user_id='93b9f73cb44b4aa2a2a886d06e37d5f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5462d05-32b7-4a99-becf-a5e5853c3fc6),volume_type_id=a5462d05-32b7-4a99-becf-a5e5853c3fc6)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Creating volume 80559aa8-41f9-43fa-94f7-bb1c40736860 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f89f9f-85c0-493c-b3d3-c3a074c66055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3056cd-38f2-4189-81f9-7d761674c5a9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:28 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 1073741824 Sep 28 05:14:28 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef692e-f68e-477c-9418-3ca9d1558f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Volume volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 (ce3056cd-38f2-4189-81f9-7d761674c5a9): created successfully Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef692e-f68e-477c-9418-3ca9d1558f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Flow 'volume_create_manager' (321b82a1-538c-42d3-a18c-fc6a13aa6417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f48f60c7-4d4f-4c00-8af4-5546f0ed5b06 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Created volume successfully. Sep 28 05:14:28 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4d39c789-fe11-40c5-89ad-00a48db4201c" returned: 0 in 0.313s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Lock "cinder-quobyte-4d39c789-fe11-40c5-89ad-00a48db4201c" released by "delete_volume" :: held 0.833s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-e98c1ac0-f043-4a86-8f2a-82d96dda0fae-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-e98c1ac0-f043-4a86-8f2a-82d96dda0fae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Created reservations ['39559e3f-523e-4dfc-bb50-dbd9ad726d53'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-e98c1ac0-f043-4a86-8f2a-82d96dda0fae" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Created reservations ['7cd3f178-9ab9-4222-9f19-4dacf52d77d0', '5cd5c587-17d6-473e-bbde-045aa1d5151d', 'bea87277-f38d-4076-87a3-22aa973d2044', 'b2a196ae-ceb0-4940-8d90-712ea9bbe4aa'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-e98c1ac0-f043-4a86-8f2a-82d96dda0fae" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Deleting offline snapshot e98c1ac0-f043-4a86-8f2a-82d96dda0fae of volume 7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] snapshot_file for this snap is: volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a3bada-284d-425e-9411-12b243d2bef8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:29 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae Sep 28 05:14:29 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:29 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:29 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:29 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:29 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:29 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 1073741824" returned: 0 in 0.581s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:29 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 Sep 28 05:14:29 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:29 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.275s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:14:29 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.286s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:29 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae" returned: 0 in 0.463s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b592573-4643-47e2-b9fc-a1af38120058(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-962d31f7-1de2-4782-812e-82a7a75d2a4c tempest-GroupsV314Test-1425179726 None] Delete group completed successfully. Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e87318-f305-4703-880f-efb9a18e535f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:29 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860" returned: 0 in 0.299s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfea5166-e902-4369-b1f7-9b71f95d8eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80559aa8-41f9-43fa-94f7-bb1c40736860', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb100104-9f64-4999-8e21-fca30d5e4949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:29 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Volume volume-80559aa8-41f9-43fa-94f7-bb1c40736860 (80559aa8-41f9-43fa-94f7-bb1c40736860): created successfully Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb100104-9f64-4999-8e21-fca30d5e4949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Flow 'volume_create_manager' (66e3733f-5f28-4ee2-a8b8-de4ade1fd92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-96d15b76-0a83-48e5-8765-1a21199faa3b tempest-VolumeTypesAccessTest-1114159396 None] Created volume successfully. Sep 28 05:14:29 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 Sep 28 05:14:29 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:30 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058" returned: 0 in 0.398s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:30 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae Sep 28 05:14:30 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-12f82e3e-ba83-453d-8728-b9c1a7f7213c req-b35058c2-73bd-45c9-ae2c-e858facb8b0c tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-12f82e3e-ba83-453d-8728-b9c1a7f7213c req-b35058c2-73bd-45c9-ae2c-e858facb8b0c tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-12f82e3e-ba83-453d-8728-b9c1a7f7213c req-b35058c2-73bd-45c9-ae2c-e858facb8b0c tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:30 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:30 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae Sep 28 05:14:30 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-12f82e3e-ba83-453d-8728-b9c1a7f7213c req-b35058c2-73bd-45c9-ae2c-e858facb8b0c tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-ce3056cd-38f2-4189-81f9-7d761674c5a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc489348-a738-4f84-8658-4f479b879aca', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:14:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-12f82e3e-ba83-453d-8728-b9c1a7f7213c req-b35058c2-73bd-45c9-ae2c-e858facb8b0c tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] attachment_update completed successfully. Sep 28 05:14:30 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058.e98c1ac0-f043-4a86-8f2a-82d96dda0fae" returned: 0 in 0.333s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-e98c1ac0-f043-4a86-8f2a-82d96dda0fae" released by "_delete_snapshot" :: held 1.783s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" released by "delete_snapshot" :: held 1.819s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Acquiring lock "cinder-80559aa8-41f9-43fa-94f7-bb1c40736860-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "cinder-80559aa8-41f9-43fa-94f7-bb1c40736860-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Acquiring lock "cinder-quobyte-80559aa8-41f9-43fa-94f7-bb1c40736860" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['821d60aa-36d6-44ff-8b86-01cda9df8600', '4691bb7c-fd27-4b2d-b918-289b91e21c06', '29f5469f-019d-4036-b218-8b282610265c', 'ed9815b0-c4cd-42f0-aec3-2c4aff09d07d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "cinder-quobyte-80559aa8-41f9-43fa-94f7-bb1c40736860" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f258397-06f0-426f-a565-e145734a9869]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Delete snapshot completed successfully. Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c59c6635-2c0a-46cc-9595-c2a7b45d50e2 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-e98c1ac0-f043-4a86-8f2a-82d96dda0fae-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:31 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 Sep 28 05:14:31 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:31 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860" returned: 0 in 0.529s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:31 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860 Sep 28 05:14:31 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:32 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-80559aa8-41f9-43fa-94f7-bb1c40736860" returned: 0 in 0.294s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "cinder-quobyte-80559aa8-41f9-43fa-94f7-bb1c40736860" released by "delete_volume" :: held 0.892s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:32 devstack cinder-volume[86815]: WARNING cinder.quota [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1381317910 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1381317910, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:14:32 devstack cinder-volume[86815]: WARNING cinder.quota [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1381317910 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1381317910, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Created reservations ['99de63ad-8810-4010-b3f5-6c7bc44de74d', '8cb11115-b02c-4a32-b4f6-e755c1ce7fd7', 'e9389cdf-bb52-475d-aabb-10dc1d1bda93', '75a8ab3b-e61d-4390-af21-33cfd75e35ae'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:32 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:32 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:32 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.344s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Deleted volume successfully. Sep 28 05:14:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b4cfe0be-874f-4978-89b6-f08d922fd3cd tempest-VolumeTypesAccessTest-1114159396 None] Lock "cinder-80559aa8-41f9-43fa-94f7-bb1c40736860-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (3834d798-ff8e-4e5b-b5c1-e06c45c26852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20520eb0-70c5-4166-8c7b-4f6c307e2f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20520eb0-70c5-4166-8c7b-4f6c307e2f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-545794626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92061e29-4c72-4b5a-878b-0320dfb18629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:33Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d2055-9447-4ce0-85e3-ec801f700d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d2055-9447-4ce0-85e3-ec801f700d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4ebe63-115c-4d9e-a406-43521dffd89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4ebe63-115c-4d9e-a406-43521dffd89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92061e29-4c72-4b5a-878b-0320dfb18629', 'volume_name': 'volume-92061e29-4c72-4b5a-878b-0320dfb18629', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b55d81-8bca-4ff5-a367-dfae5668088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b55d81-8bca-4ff5-a367-dfae5668088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a9bd8-985b-407f-ac68-90233a45502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:33 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Volume 92061e29-4c72-4b5a-878b-0320dfb18629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92061e29-4c72-4b5a-878b-0320dfb18629', 'volume_size': 1} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-545794626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92061e29-4c72-4b5a-878b-0320dfb18629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:33Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Creating volume 92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:33 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:33 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 1073741824 Sep 28 05:14:33 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:33 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 1073741824" returned: 0 in 0.560s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:33 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:33 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:34 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.292s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a9bd8-985b-407f-ac68-90233a45502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92061e29-4c72-4b5a-878b-0320dfb18629', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa47b91-ae83-42a8-9e72-f78736d66a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:34 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Volume volume-92061e29-4c72-4b5a-878b-0320dfb18629 (92061e29-4c72-4b5a-878b-0320dfb18629): created successfully Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa47b91-ae83-42a8-9e72-f78736d66a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (3834d798-ff8e-4e5b-b5c1-e06c45c26852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a755749c-11fc-4d82-947e-b617881bf85a tempest-VolumesSnapshotTestJSON-504785076 None] Created volume successfully. Sep 28 05:14:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-3bc7b5b9-b39c-4bbf-a599-aaef21b49c09 req-39d86cbf-220a-4793-83b0-a83d9ee4be1b tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Terminate volume connection completed successfully. Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3bc7b5b9-b39c-4bbf-a599-aaef21b49c09 req-39d86cbf-220a-4793-83b0-a83d9ee4be1b tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Deleting attachment dc489348-a738-4f84-8658-4f479b879aca. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Creating offline snapshot ed741fa4-52ee-4033-b1aa-812cdd466072 of volume 92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa65521-e8d2-4c6e-8176-6dcff2a646d2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:35 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:35 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "cinder-ce3056cd-38f2-4189-81f9-7d761674c5a9-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "cinder-ce3056cd-38f2-4189-81f9-7d761674c5a9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "cinder-quobyte-ce3056cd-38f2-4189-81f9-7d761674c5a9" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:36 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.587s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "cinder-quobyte-ce3056cd-38f2-4189-81f9-7d761674c5a9" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:36 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 1G Sep 28 05:14:36 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ba09a4-87b4-44c2-9338-180c1ce18a04]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:36 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 Sep 28 05:14:36 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:36 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 1G" returned: 0 in 0.562s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92061e29-4c72-4b5a-878b-0320dfb18629 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:36 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9" returned: 0 in 0.524s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:36 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92061e29-4c72-4b5a-878b-0320dfb18629 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:36 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:36 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9 Sep 28 05:14:36 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:37 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:37 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92061e29-4c72-4b5a-878b-0320dfb18629 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.386s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:37 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 is being set with open permissions: ugo+rw Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ce3056cd-38f2-4189-81f9-7d761674c5a9" returned: 0 in 0.373s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:37 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:37 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "cinder-quobyte-ce3056cd-38f2-4189-81f9-7d761674c5a9" released by "delete_volume" :: held 0.990s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Created reservations ['e76aead9-cf2a-47ab-90d8-fd71de2f9d82', '8ade192d-35fe-4c85-9643-341a208613c5', '0c5c39bb-a303-4bec-9c3d-91036b2e8418', 'b783d1b6-b228-4998-bf79-93162d8c9b09'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:37 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:37 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:37 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.332s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:37 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info Sep 28 05:14:37 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:37 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.383s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Deleted volume successfully. Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3b83b30d-b25c-4899-9fcc-2adce146f320 tempest-TestServerVolumeAttachScenarioOldVersion-1006541624 None] Lock "cinder-ce3056cd-38f2-4189-81f9-7d761674c5a9-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:37 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:37 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info is being set with open permissions: ugo+rw Sep 28 05:14:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:37 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info Sep 28 05:14:37 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:38 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.info" returned: 0 in 0.294s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e5428957-98cf-4b36-9198-940c89e0c833 tempest-VolumesSnapshotTestJSON-504785076 None] Create snapshot completed successfully Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (9cf196e7-6885-46b9-8e98-afeba68f2512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befddfda-1457-4818-9885-ff4860727157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befddfda-1457-4818-9885-ff4860727157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1034464873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed89cbc1-e767-4a00-8675-f1384dc1fbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ed741fa4-52ee-4033-b1aa-812cdd466072,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:40Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f881cd68-2f45-4044-8ce6-4f99f6699a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f881cd68-2f45-4044-8ce6-4f99f6699a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f381f9-4f66-4204-a5e3-6bd71b786702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f381f9-4f66-4204-a5e3-6bd71b786702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed89cbc1-e767-4a00-8675-f1384dc1fbbb', 'volume_name': 'volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb', 'volume_size': 2, 'snapshot_id': 'ed741fa4-52ee-4033-b1aa-812cdd466072'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f02278-8410-4643-a3ed-2759302ae59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f02278-8410-4643-a3ed-2759302ae59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8f5dd-4de8-439c-b924-14c38930aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Volume ed89cbc1-e767-4a00-8675-f1384dc1fbbb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb', 'volume_size': 2, 'snapshot_id': 'ed741fa4-52ee-4033-b1aa-812cdd466072'} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Creating volume ed89cbc1-e767-4a00-8675-f1384dc1fbbb from snapshot ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] snapshot: ed741fa4-52ee-4033-b1aa-812cdd466072, volume: ed89cbc1-e767-4a00-8675-f1384dc1fbbb, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710fe30-f3e9-4e8a-b71b-640f4e895c49]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:40 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:40 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:40 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.525s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92061e29-4c72-4b5a-878b-0320dfb18629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b5112c-ce26-4d22-87aa-32d6cfb59ad7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:40 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:40 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:41 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.611s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:14:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:14:41 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:14:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:41 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb Sep 28 05:14:41 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:50 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" returned: 0 in 8.881s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:14:50 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Converted 1024.00 MB image at 115.28 MB/s Sep 28 05:14:50 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb is being set with open permissions: ugo+rw Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:50 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb Sep 28 05:14:50 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:50 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" released by "_copy_volume_from_snapshot" :: held 10.526s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" released by "_create_volume_from_snapshot" :: held 10.643s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.665s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8f5dd-4de8-439c-b924-14c38930aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb', 'volume_size': 2, 'snapshot_id': 'ed741fa4-52ee-4033-b1aa-812cdd466072'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ee186a-d5c2-47dd-bc66-4378348239a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:50 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Volume volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb (ed89cbc1-e767-4a00-8675-f1384dc1fbbb): created successfully Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ee186a-d5c2-47dd-bc66-4378348239a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (9cf196e7-6885-46b9-8e98-afeba68f2512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4ff064a3-c183-4712-b8fb-fb4ff55d493a tempest-VolumesSnapshotTestJSON-504785076 None] Created volume successfully. Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Flow 'volume_create_manager' (d04f6e09-653f-446a-9539-4555526e1b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728db6dd-5fe5-44ee-9d0c-51f1795659dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728db6dd-5fe5-44ee-9d0c-51f1795659dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-922494108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09371607-bf7e-4be7-bfc5-385a55f28d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b820a97e94584678a591e2631cb89271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:51Z,use_quota=True,user_id='849d3728d0544b49963c6fcfa49502c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4647e2-d3ce-4c2f-8cb8-e2d648245ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4647e2-d3ce-4c2f-8cb8-e2d648245ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f536c4-fa1b-4bd4-8ce8-0c936aa981c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f536c4-fa1b-4bd4-8ce8-0c936aa981c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09371607-bf7e-4be7-bfc5-385a55f28d9b', 'volume_name': 'volume-09371607-bf7e-4be7-bfc5-385a55f28d9b', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd83480-b53a-4d0b-bbd5-1feb2a131ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd83480-b53a-4d0b-bbd5-1feb2a131ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553b173-4cfe-4c5a-b82c-fabe062cde8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Volume 09371607-bf7e-4be7-bfc5-385a55f28d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09371607-bf7e-4be7-bfc5-385a55f28d9b', 'volume_size': 1} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-922494108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09371607-bf7e-4be7-bfc5-385a55f28d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b820a97e94584678a591e2631cb89271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:51Z,use_quota=True,user_id='849d3728d0544b49963c6fcfa49502c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Creating volume 09371607-bf7e-4be7-bfc5-385a55f28d9b {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:51 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b 1073741824 Sep 28 05:14:51 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-ed89cbc1-e767-4a00-8675-f1384dc1fbbb-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ed89cbc1-e767-4a00-8675-f1384dc1fbbb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b6ad7-98e8-4d28-9a14-3f86cd72edd8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:51 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb Sep 28 05:14:51 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:51 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b 1073741824" returned: 0 in 0.584s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:51 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" returned: 0 in 0.410s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:51 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb Sep 28 05:14:51 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:51 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b Sep 28 05:14:51 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:52 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b" returned: 0 in 0.342s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553b173-4cfe-4c5a-b82c-fabe062cde8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09371607-bf7e-4be7-bfc5-385a55f28d9b', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:52 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df82d8eb-5f95-4e92-a99c-388cac4dca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" returned: 0 in 0.424s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed89cbc1-e767-4a00-8675-f1384dc1fbbb" released by "delete_volume" :: held 0.895s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Volume volume-09371607-bf7e-4be7-bfc5-385a55f28d9b (09371607-bf7e-4be7-bfc5-385a55f28d9b): created successfully Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df82d8eb-5f95-4e92-a99c-388cac4dca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Flow 'volume_create_manager' (d04f6e09-653f-446a-9539-4555526e1b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-52a24236-f5a7-41df-95ba-13a56c079039 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Created volume successfully. Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['6a32c6a7-da66-4c3a-9d41-be7505bdb18a', 'f7bd181e-f42a-4dc9-94c6-a4f1c7bccdc3', '2289b964-a42a-4ce2-ad6a-b6c6474cde39', 'f3320dc1-e16d-49c2-911d-5330023da55c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:52 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:52 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:52 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Deleted volume successfully. Sep 28 05:14:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-28f419b1-98dd-4192-8505-3079ecf50032 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ed89cbc1-e767-4a00-8675-f1384dc1fbbb-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-ed741fa4-52ee-4033-b1aa-812cdd466072-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ed741fa4-52ee-4033-b1aa-812cdd466072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Deleting offline snapshot ed741fa4-52ee-4033-b1aa-812cdd466072 of volume 92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] snapshot_file for this snap is: volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aa623f-3eef-494b-a2e7-54c45cf31cc1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:53 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:53 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:54 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.522s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92061e29-4c72-4b5a-878b-0320dfb18629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95cda38-6ca7-4ae4-be9c-28fafae8cd9e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:54 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:54 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Acquiring lock "cinder-09371607-bf7e-4be7-bfc5-385a55f28d9b-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "cinder-09371607-bf7e-4be7-bfc5-385a55f28d9b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Acquiring lock "cinder-quobyte-09371607-bf7e-4be7-bfc5-385a55f28d9b" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "cinder-quobyte-09371607-bf7e-4be7-bfc5-385a55f28d9b" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d7d60-e1b6-495a-80be-69015ce6246a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:54 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b Sep 28 05:14:54 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:54 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.690s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:54 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:54 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:55 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b" returned: 0 in 0.486s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:55 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b Sep 28 05:14:55 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:55 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Flow 'volume_create_manager' (2eca45ba-0d8c-4a81-ad9a-79a52641bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e547cc5-381b-41b8-ba40-b05ab5f669da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.514s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e547cc5-381b-41b8-ba40-b05ab5f669da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1691138137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446f698c-c0f2-48b6-bda7-c1e5a7caff5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83cc5fecd3a4046be37aa2babb42764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:55Z,use_quota=True,user_id='b88e1ecc672a42928e479d7679020b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:55 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072 Sep 28 05:14:55 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e61060-7539-415d-bb30-4f8c78e80f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:55 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e61060-7539-415d-bb30-4f8c78e80f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a548f60-61c2-4da6-ad19-36648d9afdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a548f60-61c2-4da6-ad19-36648d9afdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446f698c-c0f2-48b6-bda7-c1e5a7caff5d', 'volume_name': 'volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d7e4ae-7b44-4421-ac2b-f372ef9f51b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d7e4ae-7b44-4421-ac2b-f372ef9f51b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b467408a-479d-4c69-b008-9978faf2f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Volume 446f698c-c0f2-48b6-bda7-c1e5a7caff5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d', 'volume_size': 1} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1691138137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446f698c-c0f2-48b6-bda7-c1e5a7caff5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83cc5fecd3a4046be37aa2babb42764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:55Z,use_quota=True,user_id='b88e1ecc672a42928e479d7679020b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Creating volume 446f698c-c0f2-48b6-bda7-c1e5a7caff5d {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:55 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-09371607-bf7e-4be7-bfc5-385a55f28d9b" returned: 0 in 0.389s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:55 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d 1073741824 Sep 28 05:14:55 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "cinder-quobyte-09371607-bf7e-4be7-bfc5-385a55f28d9b" released by "delete_volume" :: held 0.981s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Created reservations ['919999a9-e991-4b45-b394-f41fae4c9802', '0403fb82-b6f2-42ef-bb97-61d5050b8bfb', '950d603b-ebf0-426a-9f62-047b71852f20', 'd35e1a4e-bfd1-460c-867b-49c3b1b561b1'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:55 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629.ed741fa4-52ee-4033-b1aa-812cdd466072" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:55 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:55 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ed741fa4-52ee-4033-b1aa-812cdd466072" released by "_delete_snapshot" :: held 2.228s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" released by "delete_snapshot" :: held 2.256s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['830da0ab-f6a2-43cf-99ed-8bf69117e671', 'c02a1ad7-d68e-4e98-bf38-4afa007992f6', '4bbe0631-4ce1-45ef-935f-b62a1b15fef7', '2eea9983-097a-475f-a9a9-65e596ed91e8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Delete snapshot completed successfully. Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-54f808a6-0cbc-4033-a414-0349482a1d35 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ed741fa4-52ee-4033-b1aa-812cdd466072-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:55 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Deleted volume successfully. Sep 28 05:14:55 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d 1073741824" returned: 0 in 0.597s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-20045231-eb8a-450f-ab78-3c73abce45c1 tempest-VolumeQuotasNegativeTestJSON-761001089 None] Lock "cinder-09371607-bf7e-4be7-bfc5-385a55f28d9b-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:56 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d Sep 28 05:14:56 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:56 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" returned: 0 in 0.269s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b467408a-479d-4c69-b008-9978faf2f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa35234-c6ab-49fa-ba03-ca4b0cac1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Volume volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d (446f698c-c0f2-48b6-bda7-c1e5a7caff5d): created successfully Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa35234-c6ab-49fa-ba03-ca4b0cac1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Flow 'volume_create_manager' (2eca45ba-0d8c-4a81-ad9a-79a52641bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a3600b48-bc4c-4815-b32d-1a23271ad271 tempest-VolumesMetadataTest-352667495 None] Created volume successfully. Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-92061e29-4c72-4b5a-878b-0320dfb18629-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-92061e29-4c72-4b5a-878b-0320dfb18629-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc149634-4870-4729-b350-911225ec6b9f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:57 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:57 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:57 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.417s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:57 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629 Sep 28 05:14:57 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:57 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-92061e29-4c72-4b5a-878b-0320dfb18629" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-92061e29-4c72-4b5a-878b-0320dfb18629" released by "delete_volume" :: held 0.851s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['71fb54fe-a701-466d-88ac-647d5d90876f', '910192d4-eec8-4b39-8406-513b20caccd1', '79123c02-0b93-45e6-8fa5-34a594d36c69', '67af4cd7-252d-46bb-bd9e-385ca088699c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:57 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:14:57 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:58 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.375s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:14:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Deleted volume successfully. Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-358be1b4-9e65-4257-8e8c-105510355ef6 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-92061e29-4c72-4b5a-878b-0320dfb18629-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Acquiring lock "cinder-446f698c-c0f2-48b6-bda7-c1e5a7caff5d-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (00f85691-d0fc-4823-89c1-f8ed2e186953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d305ae-955d-43ad-9939-d363d5a599c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "cinder-446f698c-c0f2-48b6-bda7-c1e5a7caff5d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d305ae-955d-43ad-9939-d363d5a599c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-63265558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab34af59-a8c0-492d-8724-5aeda4d25c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:59Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69872596-5188-40c8-a1ee-71877a879eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69872596-5188-40c8-a1ee-71877a879eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47995296-f0ce-49b4-9b1b-f0083b23adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47995296-f0ce-49b4-9b1b-f0083b23adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab34af59-a8c0-492d-8724-5aeda4d25c24', 'volume_name': 'volume-ab34af59-a8c0-492d-8724-5aeda4d25c24', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805bc064-670e-4bef-bef2-611c8cd6c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805bc064-670e-4bef-bef2-611c8cd6c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880c36e5-24e2-4b3e-9749-5f34ea31b120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:14:58 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Volume ab34af59-a8c0-492d-8724-5aeda4d25c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab34af59-a8c0-492d-8724-5aeda4d25c24', 'volume_size': 1} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-63265558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab34af59-a8c0-492d-8724-5aeda4d25c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:14:59Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Creating volume ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:14:58 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:58 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 1073741824 Sep 28 05:14:58 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Acquiring lock "cinder-quobyte-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "cinder-quobyte-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ebdf5d-0e78-4c51-81e1-3e42d4b2e828]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:14:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:59 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d Sep 28 05:14:59 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:59 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 1073741824" returned: 0 in 0.671s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:59 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" returned: 0 in 0.582s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:59 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:14:59 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:59 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:14:59 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:14:59 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" returned: 0 in 0.375s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:14:59 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "cinder-quobyte-446f698c-c0f2-48b6-bda7-c1e5a7caff5d" released by "delete_volume" :: held 1.021s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880c36e5-24e2-4b3e-9749-5f34ea31b120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab34af59-a8c0-492d-8724-5aeda4d25c24', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:14:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75a2082-b0c5-4c92-91cd-c434a0b2a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:00 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Volume volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 (ab34af59-a8c0-492d-8724-5aeda4d25c24): created successfully Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75a2082-b0c5-4c92-91cd-c434a0b2a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (00f85691-d0fc-4823-89c1-f8ed2e186953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c406dee4-a52d-4e8c-af4b-80b8a5358b22 tempest-VolumesSnapshotTestJSON-504785076 None] Created volume successfully. Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Created reservations ['72306382-d3c4-4d85-a3fa-fdb6cf085529', 'ccdc2ace-d168-4bd4-bc1f-4d626cbdc231', '022cf1fc-bd77-488d-a590-ed5753352a18', '0b194f29-19d4-4ed6-a1d9-125ff600bc38'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:00 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:00 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:00 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Deleted volume successfully. Sep 28 05:15:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bd5f9d1c-0b18-4856-b5ff-ea91ffea48f8 tempest-VolumesMetadataTest-352667495 None] Lock "cinder-446f698c-c0f2-48b6-bda7-c1e5a7caff5d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Creating offline snapshot b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 of volume ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86874413-3595-4a72-9009-c7753ce955b0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:01 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:15:01 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:01 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:01 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 1G Sep 28 05:15:01 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:02 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 1G" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:02 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:02 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:02 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:02 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 is being set with open permissions: ugo+rw Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:02 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:02 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:02 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.308s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:02 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info Sep 28 05:15:02 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:03 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info" returned: 0 in 0.317s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:03 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info is being set with open permissions: ugo+rw Sep 28 05:15:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:03 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info Sep 28 05:15:03 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:03 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.info" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c89d9a84-81df-4b18-936d-a521a06563bc tempest-VolumesSnapshotTestJSON-504785076 None] Create snapshot completed successfully Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (bdc9b5e5-bc38-4c28-b8c3-f61bfe24be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30110ba1-515b-40e2-b1ff-fdc8403957d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30110ba1-515b-40e2-b1ff-fdc8403957d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1566169886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45910321434d0281eb65b98e9eb18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:05Z,use_quota=True,user_id='5e52fa33e9cd440ab367e9c1aa69deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee98dfe2-259a-4fdd-8cd3-e5aa12620fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee98dfe2-259a-4fdd-8cd3-e5aa12620fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1d3e53-22e9-444c-ae89-4392b1399b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1d3e53-22e9-444c-ae89-4392b1399b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b', 'volume_name': 'volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b', 'volume_size': 1, 'snapshot_id': 'b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af06e449-7e8f-466e-88a0-6ea14ae50099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af06e449-7e8f-466e-88a0-6ea14ae50099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce10182-4ef6-45e7-9a14-53c73352c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:05 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Volume 17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b', 'volume_size': 1, 'snapshot_id': 'b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24'} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Creating volume 17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b from snapshot b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] snapshot: b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24, volume: 17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe45505-0664-4aa2-9498-6bc627fe0f6f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:05 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:05 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:06 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.524s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab34af59-a8c0-492d-8724-5aeda4d25c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e557d254-78a7-4812-8b72-12f2c0856ff3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:06 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:15:06 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:06 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.494s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:06 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b Sep 28 05:15:06 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=134,cinder:UPDATE=132,cinder:DELETE=10,cinder:INSERT=28 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=123,cinder:UPDATE=144,cinder:INSERT=38,cinder:DELETE=11 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (185a00f9-c12f-4ec7-8414-cf576052bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d989f8c3-51f1-46fb-b6d8-f7bebf2ee0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d989f8c3-51f1-46fb-b6d8-f7bebf2ee0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1597932095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea229b-3970-4589-bebe-a9382478b4fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:07Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c8ab5d-d6db-41bb-ad06-0677eb63987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c8ab5d-d6db-41bb-ad06-0677eb63987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4c6bc-aae8-46b8-8ed9-6219a4581c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4c6bc-aae8-46b8-8ed9-6219a4581c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ea229b-3970-4589-bebe-a9382478b4fe', 'volume_name': 'volume-14ea229b-3970-4589-bebe-a9382478b4fe', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17d2681-2182-4dbb-b19e-1a69ae5a50a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17d2681-2182-4dbb-b19e-1a69ae5a50a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0d8ff1-ee27-4799-b57b-7bf0c0f1283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Volume 14ea229b-3970-4589-bebe-a9382478b4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ea229b-3970-4589-bebe-a9382478b4fe', 'volume_size': 1} Sep 28 05:15:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:15 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" returned: 0 in 8.814s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24, size 1024.00 MB, duration 8.82 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:15:15 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Converted 1024.00 MB image at 116.16 MB/s Sep 28 05:15:15 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b is being set with open permissions: ugo+rw Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:15 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b Sep 28 05:15:15 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:15 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" returned: 0 in 0.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" released by "_copy_volume_from_snapshot" :: held 10.244s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" released by "_create_volume_from_snapshot" :: held 10.324s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.349s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.668s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1597932095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea229b-3970-4589-bebe-a9382478b4fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:07Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Creating volume 14ea229b-3970-4589-bebe-a9382478b4fe {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:15 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce10182-4ef6-45e7-9a14-53c73352c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b', 'volume_size': 1, 'snapshot_id': 'b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:15 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe 1073741824 Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a8975d-9bbc-4821-8e52-b35d3adc897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:15 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Volume volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b (17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b): created successfully Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a8975d-9bbc-4821-8e52-b35d3adc897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Flow 'volume_create_manager' (bdc9b5e5-bc38-4c28-b8c3-f61bfe24be31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-492bedba-fe4c-460f-90ab-7d5d2c5497f3 tempest-VolumesSnapshotTestJSON-504785076 None] Created volume successfully. Sep 28 05:15:16 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe 1073741824" returned: 0 in 0.531s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:16 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe Sep 28 05:15:16 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b87a90-7100-4dc8-9a9b-6489d0b99052]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:16 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0d8ff1-ee27-4799-b57b-7bf0c0f1283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ea229b-3970-4589-bebe-a9382478b4fe', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509268bf-4b0a-44e4-9310-ab29b1eb8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:16 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Volume volume-14ea229b-3970-4589-bebe-a9382478b4fe (14ea229b-3970-4589-bebe-a9382478b4fe): created successfully Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509268bf-4b0a-44e4-9310-ab29b1eb8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:16 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b Sep 28 05:15:16 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (185a00f9-c12f-4ec7-8414-cf576052bab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9810a089-8b77-4e0e-8e24-602f5b412414 tempest-VolumesListTestJSON-37236319 None] Created volume successfully. Sep 28 05:15:17 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" returned: 0 in 0.496s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:17 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b Sep 28 05:15:17 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:17 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" returned: 0 in 0.311s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b" released by "delete_volume" :: held 0.874s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['617c734a-a6b0-4d85-8f61-5712c24606f8', '6e02db2f-e833-4eef-b78c-dee44424606f', '46164a2c-5962-4e76-acfd-ec19134a9fc6', '86d8ed2f-a568-4a67-8458-103520bc725f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:17 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:17 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (1ab01c73-725f-4772-a63d-38da5fa43782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ff6896-475c-4720-910f-40365f745225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ff6896-475c-4720-910f-40365f745225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285854886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbc48ec-2a30-4ba6-a93d-9fc8c7443918,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:18Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86006775-e8fe-4bc7-9494-41c767a3b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86006775-e8fe-4bc7-9494-41c767a3b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22400a82-c10e-435d-a82b-82affb489200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22400a82-c10e-435d-a82b-82affb489200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cbc48ec-2a30-4ba6-a93d-9fc8c7443918', 'volume_name': 'volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcd0b74-579d-46f6-b5b8-38c04d4753ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcd0b74-579d-46f6-b5b8-38c04d4753ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212144f9-1290-4e16-8620-11f1d55311b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Volume 8cbc48ec-2a30-4ba6-a93d-9fc8c7443918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918', 'volume_size': 1} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285854886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbc48ec-2a30-4ba6-a93d-9fc8c7443918,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:18Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Creating volume 8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:17 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:17 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 1073741824 Sep 28 05:15:17 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:18 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.387s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Deleted volume successfully. Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-df1083b2-6f62-46c5-adb9-8e740e40d225 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-17cc0e89-3d7b-4bc6-b3db-3affa1f0ed9b-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:18 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 1073741824" returned: 0 in 0.590s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:18 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 Sep 28 05:15:18 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Deleting offline snapshot b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 of volume ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:15:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] snapshot_file for this snap is: volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f0bd3-1bb2-4893-b66c-721cd58e5e4c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:19 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" returned: 0 in 0.450s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212144f9-1290-4e16-8620-11f1d55311b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d54a91-57ec-4185-b0ce-2a9d77f923b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Volume volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 (8cbc48ec-2a30-4ba6-a93d-9fc8c7443918): created successfully Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d54a91-57ec-4185-b0ce-2a9d77f923b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (1ab01c73-725f-4772-a63d-38da5fa43782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-de8c5210-4ea4-416e-acfa-6dd7c94f4445 tempest-VolumesListTestJSON-37236319 None] Created volume successfully. Sep 28 05:15:19 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:19 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:19 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.517s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab34af59-a8c0-492d-8724-5aeda4d25c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56951b-cfb1-453a-ae32-cb3849e1b8fa]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:19 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:15:19 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:20 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.654s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:20 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:20 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (f0a74cf9-de84-4239-a0df-3214620db0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c439efbc-59cc-4ff1-a164-bbd7ecc4b832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c439efbc-59cc-4ff1-a164-bbd7ecc4b832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-344357809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbc959d-ec70-406d-9406-7c55c9293a3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:21Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c0278a-8e97-4a00-8280-e9cd88c173fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:20 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c0278a-8e97-4a00-8280-e9cd88c173fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f876ac-844a-4981-a02d-0ba0a1ddbd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f876ac-844a-4981-a02d-0ba0a1ddbd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbc959d-ec70-406d-9406-7c55c9293a3a', 'volume_name': 'volume-bdbc959d-ec70-406d-9406-7c55c9293a3a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41092c16-4ee8-498c-8478-9afb3798be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41092c16-4ee8-498c-8478-9afb3798be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbce459-2183-41bc-b12e-6b97a21a6f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Volume bdbc959d-ec70-406d-9406-7c55c9293a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbc959d-ec70-406d-9406-7c55c9293a3a', 'volume_size': 1} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-344357809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbc959d-ec70-406d-9406-7c55c9293a3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bc730d9ef4b45179184d2f74166a844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:21Z,use_quota=True,user_id='17e3d4d4099f4315976fb77739e9c98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Creating volume bdbc959d-ec70-406d-9406-7c55c9293a3a {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:20 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.535s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:20 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a 1073741824 Sep 28 05:15:20 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:20 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24 Sep 28 05:15:20 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:21 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24.b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24" released by "_delete_snapshot" :: held 2.260s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" released by "delete_snapshot" :: held 2.303s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['3ebebb22-f839-4530-b9d2-e70c6eb560d1', 'a8373485-9334-4e42-bd38-7c3f257c28d4', '638cc82d-9c49-4a07-925d-2498764ac6b8', 'f9b9ff6e-b1c3-4049-9057-ef3362c0b86b'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:21 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a 1073741824" returned: 0 in 0.617s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Delete snapshot completed successfully. Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-ad9ff276-972d-4b68-88b1-83e99654bced tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-b52d4ba9-4a06-41d1-b8a5-d0f4e6d03c24-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:21 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a Sep 28 05:15:21 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:21 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a" returned: 0 in 0.270s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbce459-2183-41bc-b12e-6b97a21a6f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbc959d-ec70-406d-9406-7c55c9293a3a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37423247-7eb1-4e51-900b-f218bd43d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Volume volume-bdbc959d-ec70-406d-9406-7c55c9293a3a (bdbc959d-ec70-406d-9406-7c55c9293a3a): created successfully Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37423247-7eb1-4e51-900b-f218bd43d02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Flow 'volume_create_manager' (f0a74cf9-de84-4239-a0df-3214620db0f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3d380500-1a79-4938-91f8-ec45f49d7be6 tempest-VolumesListTestJSON-37236319 None] Created volume successfully. Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-ab34af59-a8c0-492d-8724-5aeda4d25c24-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ab34af59-a8c0-492d-8724-5aeda4d25c24-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c0389-44be-4311-870f-9d340aa95331]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:22 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:15:22 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:22 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.493s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:22 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24 Sep 28 05:15:22 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:23 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ab34af59-a8c0-492d-8724-5aeda4d25c24" returned: 0 in 0.341s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-ab34af59-a8c0-492d-8724-5aeda4d25c24" released by "delete_volume" :: held 0.925s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['0e965144-0a41-4528-a4e5-c197af57622f', 'c6e8d79f-769f-402a-a96c-a432f1415801', '3ebb7713-4cdb-4d3d-9a61-51b1572d0ac7', 'd0952412-0199-4141-9f55-4aac96f90399'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (5d787900-06fa-4324-b448-fd69539ce9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c63f7e6-ec61-4a4b-8f85-1a46b461cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c63f7e6-ec61-4a4b-8f85-1a46b461cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1847066535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad077587-ec26-47a4-9754-a7cad8b2e8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:23Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60457a-1570-4c56-ac27-82983cdf9833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:23 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae60457a-1570-4c56-ac27-82983cdf9833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:23 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c4b9cf-aac2-4923-8855-6f0681b98bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c4b9cf-aac2-4923-8855-6f0681b98bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad077587-ec26-47a4-9754-a7cad8b2e8ee', 'volume_name': 'volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6570c0-9314-4625-8c97-3f56be2dee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6570c0-9314-4625-8c97-3f56be2dee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c346bf56-c5c3-4ca0-ae79-899ad046b0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Volume ad077587-ec26-47a4-9754-a7cad8b2e8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee', 'volume_size': 1} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1847066535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad077587-ec26-47a4-9754-a7cad8b2e8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:23Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Creating volume ad077587-ec26-47a4-9754-a7cad8b2e8ee {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:23 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-7b592573-4643-47e2-b9fc-a1af38120058-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-7b592573-4643-47e2-b9fc-a1af38120058-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:23 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee 1073741824 Sep 28 05:15:23 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" acquired by "delete_volume" :: waited 0.046s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:23 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.397s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Deleted volume successfully. Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d6b58d-ffc5-4220-a449-355fddbfae26]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1a3d057a-fe41-4f78-b025-ef99d4de2e3b tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-ab34af59-a8c0-492d-8724-5aeda4d25c24-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:23 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 Sep 28 05:15:23 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:24 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee 1073741824" returned: 0 in 0.825s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:24 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058" returned: 0 in 0.576s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:24 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee Sep 28 05:15:24 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:24 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058 Sep 28 05:15:24 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:24 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee" returned: 0 in 0.310s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:24 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b592573-4643-47e2-b9fc-a1af38120058" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-quobyte-7b592573-4643-47e2-b9fc-a1af38120058" released by "delete_volume" :: held 0.997s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c346bf56-c5c3-4ca0-ae79-899ad046b0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abe012a-fc41-4162-b54c-7ae663dde83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Volume volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee (ad077587-ec26-47a4-9754-a7cad8b2e8ee): created successfully Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abe012a-fc41-4162-b54c-7ae663dde83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (5d787900-06fa-4324-b448-fd69539ce9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7bc498fb-cecd-4d5e-a100-76f7e7a392c6 tempest-VolumesListAdminTestJSON-765342718 None] Created volume successfully. Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Created reservations ['4aac6a95-6319-4aac-b0ec-51d2952baea9', '43a560f8-7705-48c0-b36a-6bcd3a69bbee', 'ee4f3bb9-a695-4201-9e81-14dbf00cc78a', 'b894c6e5-aa45-4216-a89e-b49aeb1314b0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:24 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:24 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:25 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:25 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Deleted volume successfully. Sep 28 05:15:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a49c9e6-a2c7-4126-b6dd-6ad7d8439702 tempest-VolumesSnapshotTestJSON-504785076 None] Lock "cinder-7b592573-4643-47e2-b9fc-a1af38120058-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-bdbc959d-ec70-406d-9406-7c55c9293a3a-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-bdbc959d-ec70-406d-9406-7c55c9293a3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-quobyte-bdbc959d-ec70-406d-9406-7c55c9293a3a" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-bdbc959d-ec70-406d-9406-7c55c9293a3a" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ded160-6b14-4513-8080-6d600950b627]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (677644ca-1ea1-42ac-9228-b481eefb8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f43feb-6f1e-408b-b462-56871d9a7176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f43feb-6f1e-408b-b462-56871d9a7176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-898477807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd85275d-4bce-455f-afd6-eec2dac25342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:26Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269fb53a-8b83-4377-b260-0ea760e7b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269fb53a-8b83-4377-b260-0ea760e7b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24bf288-8064-4b1e-81dd-7bf574c98e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24bf288-8064-4b1e-81dd-7bf574c98e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd85275d-4bce-455f-afd6-eec2dac25342', 'volume_name': 'volume-cd85275d-4bce-455f-afd6-eec2dac25342', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:26 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774034f0-9cd5-49f5-a61d-2c7ade0d1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:26 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774034f0-9cd5-49f5-a61d-2c7ade0d1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba9b672-aa9b-498b-a521-bc03dcdb2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Volume cd85275d-4bce-455f-afd6-eec2dac25342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd85275d-4bce-455f-afd6-eec2dac25342', 'volume_size': 1} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-898477807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd85275d-4bce-455f-afd6-eec2dac25342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:26Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Creating volume cd85275d-4bce-455f-afd6-eec2dac25342 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:26 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:26 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 1073741824 Sep 28 05:15:26 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:26 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a" returned: 0 in 0.479s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:26 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a Sep 28 05:15:26 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:26 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 1073741824" returned: 0 in 0.567s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:27 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bdbc959d-ec70-406d-9406-7c55c9293a3a" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-bdbc959d-ec70-406d-9406-7c55c9293a3a" released by "delete_volume" :: held 0.879s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:27 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 Sep 28 05:15:27 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Created reservations ['a85d5f60-625d-4ad4-bd52-be3cfe003d59', 'ad4e3296-78b9-4e05-8cdb-85efd95b2cc4', 'e2efc349-575f-4a11-8db4-f90bdc5f691f', '1b033f8f-a1b5-49ae-8997-2617b1e05164'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:27 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:27 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:27 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342" returned: 0 in 0.528s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba9b672-aa9b-498b-a521-bc03dcdb2534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd85275d-4bce-455f-afd6-eec2dac25342', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a8281f-e26e-46dd-a484-c8c001e2d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Volume volume-cd85275d-4bce-455f-afd6-eec2dac25342 (cd85275d-4bce-455f-afd6-eec2dac25342): created successfully Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a8281f-e26e-46dd-a484-c8c001e2d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:27 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (677644ca-1ea1-42ac-9228-b481eefb8139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.336s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-quobyte-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c984481e-236a-447f-83f1-d389d52a0708 tempest-VolumesListAdminTestJSON-765342718 None] Created volume successfully. Sep 28 05:15:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Deleted volume successfully. Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6bf1b99f-b534-43d5-9bbd-4bb1fa097987 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-bdbc959d-ec70-406d-9406-7c55c9293a3a-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4b4b4-ed27-47cb-abb5-f37df5e485e8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:27 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 Sep 28 05:15:27 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:28 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" returned: 0 in 0.414s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:28 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918 Sep 28 05:15:28 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:28 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" returned: 0 in 0.335s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918" released by "delete_volume" :: held 0.826s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Created reservations ['af75afc0-5910-4f40-82b5-3f24dc104655', '6fabbc5e-c0d5-470e-8a62-02b53d6e4c76', '88911906-b308-4024-9792-e8f632864197', '8804a35e-e089-4f6b-8e9d-5fe2a8a74afb'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:28 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:28 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-14ea229b-3970-4589-bebe-a9382478b4fe-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-14ea229b-3970-4589-bebe-a9382478b4fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (533d3e2b-0cc0-4392-8dcb-c823a3dfc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9855ee-c540-4ba3-800f-0f07f936a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "cinder-quobyte-14ea229b-3970-4589-bebe-a9382478b4fe" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9855ee-c540-4ba3-800f-0f07f936a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2011133452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32cd899-edb3-414f-9c39-f647f3a0ae15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:29Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae54bbb-4c39-4a87-b8d7-fc001ae73c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae54bbb-4c39-4a87-b8d7-fc001ae73c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d14594-0317-4a58-9f84-06f828e9d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d14594-0317-4a58-9f84-06f828e9d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32cd899-edb3-414f-9c39-f647f3a0ae15', 'volume_name': 'volume-d32cd899-edb3-414f-9c39-f647f3a0ae15', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504dcded-e29d-49fc-9178-56778a81dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504dcded-e29d-49fc-9178-56778a81dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef04abc-6d2b-4f9b-9ff9-4d585125aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:29 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Volume d32cd899-edb3-414f-9c39-f647f3a0ae15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32cd899-edb3-414f-9c39-f647f3a0ae15', 'volume_size': 1} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2011133452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32cd899-edb3-414f-9c39-f647f3a0ae15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0957d114bdb54d8e842aa43288ac7da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:29Z,use_quota=True,user_id='da7f67012db8439d9204dfe274dc622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Creating volume d32cd899-edb3-414f-9c39-f647f3a0ae15 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:29 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-14ea229b-3970-4589-bebe-a9382478b4fe" acquired by "delete_volume" :: waited 0.098s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:29 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 1073741824 Sep 28 05:15:29 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:29 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Deleted volume successfully. Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[532fae2a-7f34-4025-b11c-6765eeb4d3ca]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c3854bd-a7c8-44ff-83ec-7d9fd1741cd0 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-8cbc48ec-2a30-4ba6-a93d-9fc8c7443918-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:29 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:29 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:29 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe Sep 28 05:15:29 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:29 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.469s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:15:29 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe" returned: 0 in 0.562s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:29 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe Sep 28 05:15:29 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:29 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 1073741824" returned: 0 in 0.707s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:30 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 Sep 28 05:15:30 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:30 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-14ea229b-3970-4589-bebe-a9382478b4fe" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-quobyte-14ea229b-3970-4589-bebe-a9382478b4fe" released by "delete_volume" :: held 0.972s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:30 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15" returned: 0 in 0.304s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Created reservations ['0f12cb99-99c9-41f6-9e07-6dd3b4464ff2', '185189c2-b957-4088-84e5-e41042eaa0cc', 'df5a205f-c61d-4a0e-9120-9bdf0535481a', '65488b80-ca72-4878-ab13-e055ff296a87'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef04abc-6d2b-4f9b-9ff9-4d585125aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32cd899-edb3-414f-9c39-f647f3a0ae15', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2d25bf-b13e-4477-a77e-7a50a7533978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:30 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Volume volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 (d32cd899-edb3-414f-9c39-f647f3a0ae15): created successfully Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2d25bf-b13e-4477-a77e-7a50a7533978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Flow 'volume_create_manager' (533d3e2b-0cc0-4392-8dcb-c823a3dfc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4431a908-2bb3-4bd7-8b85-5a08a91b2742 tempest-VolumesListAdminTestJSON-765342718 None] Created volume successfully. Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:30 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:30 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:30 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.377s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Deleted volume successfully. Sep 28 05:15:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d9c2944-b0b5-4006-8815-2d7a842cfad4 tempest-VolumesListTestJSON-37236319 None] Lock "cinder-14ea229b-3970-4589-bebe-a9382478b4fe-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Flow 'volume_create_manager' (759c792d-c1a8-40b5-a561-8cb2b943650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19b1bb0-9213-486a-881e-4e7ca75ebc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19b1bb0-9213-486a-881e-4e7ca75ebc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be660e3b-1c13-4788-9adc-b1d688cfbd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8606173d8247f8a47aa33c629a8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:32Z,use_quota=True,user_id='349817ff0c5849a795f2d4847be016e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0520b04-2aa0-474d-b515-ab3322f8d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0520b04-2aa0-474d-b515-ab3322f8d04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4911ea1-cd21-4955-8b18-1a9d272882b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4911ea1-cd21-4955-8b18-1a9d272882b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be660e3b-1c13-4788-9adc-b1d688cfbd1b', 'volume_name': 'volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b9cb68-5736-40aa-8107-593a3e0ad4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b9cb68-5736-40aa-8107-593a3e0ad4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eae55b9-902b-4dd7-8f46-d18370bdf66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Volume be660e3b-1c13-4788-9adc-b1d688cfbd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b', 'volume_size': 1} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be660e3b-1c13-4788-9adc-b1d688cfbd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8606173d8247f8a47aa33c629a8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:32Z,use_quota=True,user_id='349817ff0c5849a795f2d4847be016e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Creating volume be660e3b-1c13-4788-9adc-b1d688cfbd1b {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:32 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:32 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b 1073741824 Sep 28 05:15:32 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:32 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b 1073741824" returned: 0 in 0.757s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:33 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b Sep 28 05:15:33 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:33 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eae55b9-902b-4dd7-8f46-d18370bdf66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4ca79-69e5-488c-a7f7-a127b7c869dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:33 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Volume volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b (be660e3b-1c13-4788-9adc-b1d688cfbd1b): created successfully Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4ca79-69e5-488c-a7f7-a127b7c869dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Flow 'volume_create_manager' (759c792d-c1a8-40b5-a561-8cb2b943650c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7e6cf566-7a20-4301-8161-eff9877d0c96 tempest-VolumesListAdminTestJSON-1319416254 None] Created volume successfully. Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Acquiring lock "cinder-be660e3b-1c13-4788-9adc-b1d688cfbd1b-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "cinder-be660e3b-1c13-4788-9adc-b1d688cfbd1b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Acquiring lock "cinder-quobyte-be660e3b-1c13-4788-9adc-b1d688cfbd1b" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "cinder-quobyte-be660e3b-1c13-4788-9adc-b1d688cfbd1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e81989-c6f1-44d2-b1af-d5fe4d9e59a2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-d32cd899-edb3-414f-9c39-f647f3a0ae15-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-d32cd899-edb3-414f-9c39-f647f3a0ae15-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-quobyte-d32cd899-edb3-414f-9c39-f647f3a0ae15" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:34 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b Sep 28 05:15:34 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-d32cd899-edb3-414f-9c39-f647f3a0ae15" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb32ce5-7870-4afc-a6db-d8d94e6833da]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:34 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 Sep 28 05:15:34 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:35 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b" returned: 0 in 0.502s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:35 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b Sep 28 05:15:35 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:35 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15" returned: 0 in 0.618s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:35 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15 Sep 28 05:15:35 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:35 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-be660e3b-1c13-4788-9adc-b1d688cfbd1b" returned: 0 in 0.432s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "cinder-quobyte-be660e3b-1c13-4788-9adc-b1d688cfbd1b" released by "delete_volume" :: held 1.016s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Created reservations ['6daa40f6-7dad-4ae7-9c14-be493fb381fd', '5f454484-4d73-45c9-9c1f-42ca2b53b96e', 'b9f80e12-5df1-4685-b2ba-d6f885f3c9d0', 'c96fd65c-3bb4-4f5b-a034-6df98b5a1c6d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:35 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:35 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:35 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d32cd899-edb3-414f-9c39-f647f3a0ae15" returned: 0 in 0.427s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-d32cd899-edb3-414f-9c39-f647f3a0ae15" released by "delete_volume" :: held 1.128s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:35 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Created reservations ['7fe28a8f-019e-47b8-9599-07dc26cde80b', 'dec0c02d-80d4-4696-91d1-1f42ae4d6be2', '95e9c633-6661-4710-8548-82af78a3f891', 'bb1607cd-e5a2-47d8-aa2d-320c2de18b88'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:36 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:36 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:36 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.416s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Deleted volume successfully. Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-542cb760-7b13-4607-a6c9-b5c4f471fd53 tempest-VolumesListAdminTestJSON-1319416254 None] Lock "cinder-be660e3b-1c13-4788-9adc-b1d688cfbd1b-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:36 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Deleted volume successfully. Sep 28 05:15:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-903d2923-d1b3-410b-a1f0-7508e84802df tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-d32cd899-edb3-414f-9c39-f647f3a0ae15-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-cd85275d-4bce-455f-afd6-eec2dac25342-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-cd85275d-4bce-455f-afd6-eec2dac25342-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-quobyte-cd85275d-4bce-455f-afd6-eec2dac25342" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-cd85275d-4bce-455f-afd6-eec2dac25342" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2a9d1-70c6-4acc-b3b6-f72110044648]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:37 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 Sep 28 05:15:37 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Flow 'volume_create_manager' (89783d15-532a-467e-a382-7a063a6c8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52ef823-b09b-4a58-853b-28fd515109d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52ef823-b09b-4a58-853b-28fd515109d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-477904079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df64460d-48f2-4acd-b452-1091b18b3c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10bf6cba2c8e455388698a4385babb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:38Z,use_quota=True,user_id='bc5e5b41131d4ac1ac2ba70a1fbf6dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91527ee9-670f-454e-83a9-e82070cad097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91527ee9-670f-454e-83a9-e82070cad097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbf87cd-115f-4105-a215-db821345ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbf87cd-115f-4105-a215-db821345ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df64460d-48f2-4acd-b452-1091b18b3c73', 'volume_name': 'volume-df64460d-48f2-4acd-b452-1091b18b3c73', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70645e3c-3638-4c2f-b73a-46d5b36a1e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70645e3c-3638-4c2f-b73a-46d5b36a1e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e04553-9768-4da1-b00f-06e874359f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Volume df64460d-48f2-4acd-b452-1091b18b3c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df64460d-48f2-4acd-b452-1091b18b3c73', 'volume_size': 1} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-477904079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df64460d-48f2-4acd-b452-1091b18b3c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10bf6cba2c8e455388698a4385babb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:38Z,use_quota=True,user_id='bc5e5b41131d4ac1ac2ba70a1fbf6dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Creating volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:37 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 1073741824 Sep 28 05:15:37 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:37 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342" returned: 0 in 0.463s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:37 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342 Sep 28 05:15:37 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:38 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cd85275d-4bce-455f-afd6-eec2dac25342" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-cd85275d-4bce-455f-afd6-eec2dac25342" released by "delete_volume" :: held 0.884s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:38 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Created reservations ['5cc31625-b5d0-4d42-ba46-e2837003c7b5', 'fa8016b1-5732-4eaf-bf68-edfad8d53224', '871e8dce-e874-483f-a420-93608fab2aad', 'fc63e7f5-b38a-4332-8fb8-aef453715625'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 1073741824" returned: 0 in 0.588s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:38 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 Sep 28 05:15:38 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Flow 'volume_create_manager' (eda53692-a42e-4857-9e03-16427e6319c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda6e051-f820-45a9-a923-efd6131c5c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda6e051-f820-45a9-a923-efd6131c5c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1891925912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a0be93-2072-4dc5-8b3d-ada8470650ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f1d54a14e546e29476e71622e2fafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:38Z,use_quota=True,user_id='eac350d5aa1b410f9dfc61299d0a17ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab5fbbe-c8f0-4df2-a143-992b16b9abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab5fbbe-c8f0-4df2-a143-992b16b9abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82869650-9579-48ce-bd05-5e2a646b03fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82869650-9579-48ce-bd05-5e2a646b03fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a0be93-2072-4dc5-8b3d-ada8470650ed', 'volume_name': 'volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed', 'volume_size': 2}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a60c5-1d55-4d54-9fd0-75ce89aeb051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359a60c5-1d55-4d54-9fd0-75ce89aeb051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbee33b0-967e-488a-807b-ccac6e294108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Volume d2a0be93-2072-4dc5-8b3d-ada8470650ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed', 'volume_size': 2} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Flow 'volume_create_manager' (f5cdcc2c-4b0c-4ca1-bc8b-93c920ebe627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bf22a-69d8-43bc-8546-1bf249ffa1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bf22a-69d8-43bc-8546-1bf249ffa1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1451616551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af919f81-57b4-4a48-ad9f-5f339c5a9ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cdfefcf7bf4b36aed7c1a3a9c4dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:39Z,use_quota=True,user_id='745fb6e68f2e40b6a9e9b0d5c78e404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e1276d-d83d-4c9e-9b1b-08a98c8cb147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e1276d-d83d-4c9e-9b1b-08a98c8cb147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e96f87-8255-4b82-bbf6-d6016799b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:15:38 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1891925912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a0be93-2072-4dc5-8b3d-ada8470650ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f1d54a14e546e29476e71622e2fafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:38Z,use_quota=True,user_id='eac350d5aa1b410f9dfc61299d0a17ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Creating volume d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:38 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed 2147483648 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:38 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-ad077587-ec26-47a4-9754-a7cad8b2e8ee-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:38 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed 2147483648 Sep 28 05:15:38 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Deleted volume successfully. Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e04553-9768-4da1-b00f-06e874359f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df64460d-48f2-4acd-b452-1091b18b3c73', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4470abd-0def-44a4-b82f-24b15f3b7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-ad077587-ec26-47a4-9754-a7cad8b2e8ee-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Volume volume-df64460d-48f2-4acd-b452-1091b18b3c73 (df64460d-48f2-4acd-b452-1091b18b3c73): created successfully Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4470abd-0def-44a4-b82f-24b15f3b7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Flow 'volume_create_manager' (89783d15-532a-467e-a382-7a063a6c8555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-423369e6-48a7-4350-8309-c7d63bb89528 tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-cd85275d-4bce-455f-afd6-eec2dac25342-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e0d9d7b0-99a2-419d-a825-b4ad199fde31 tempest-VolumesSnapshotListTestJSON-1904814838 None] Created volume successfully. Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "cinder-quobyte-ad077587-ec26-47a4-9754-a7cad8b2e8ee" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-ad077587-ec26-47a4-9754-a7cad8b2e8ee" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c4dff-4852-46b6-a8db-3b2a996d6d4e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:39 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee Sep 28 05:15:39 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e96f87-8255-4b82-bbf6-d6016799b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'volume_name': 'volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a3b7e5-6025-4466-af51-39763af16de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a3b7e5-6025-4466-af51-39763af16de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889ef49-2693-4f09-98ba-ce80e8c9a01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Trying to clone af919f81-57b4-4a48-ad9f-5f339c5a9ed6 from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:15:39 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed 2147483648" returned: 0 in 0.578s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:39 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:39 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed Sep 28 05:15:39 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:39 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee Sep 28 05:15:39 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:15:39 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Image download 20.69 MB at 20.69 MB/s Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99587f-119b-4b59-925b-899f88ff9684]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:39 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD Sep 28 05:15:39 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:39 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbee33b0-967e-488a-807b-ccac6e294108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed', 'volume_size': 2}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263bf1b7-1ec1-485c-bffe-9e8162897466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:39 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ad077587-ec26-47a4-9754-a7cad8b2e8ee" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-quobyte-ad077587-ec26-47a4-9754-a7cad8b2e8ee" released by "delete_volume" :: held 0.822s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Volume volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed (d2a0be93-2072-4dc5-8b3d-ada8470650ed): created successfully Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263bf1b7-1ec1-485c-bffe-9e8162897466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Flow 'volume_create_manager' (eda53692-a42e-4857-9e03-16427e6319c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4f508faa-3861-41eb-90a6-a70d34418cef tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Created volume successfully. Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Created reservations ['804575c9-da6f-47a9-8e45-64a62a7b4891', 'aedad4fb-8e98-46c4-9961-983c6b987f91', 'b820eb19-506c-4520-9804-57fbe0841c28', 'e1b2e79a-5468-4067-8311-591b41023eb0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:39 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:39 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b is fetched for user 745fb6e68f2e40b6a9e9b0d5c78e404d. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:15:39 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:39 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5fab8c-7a44-41ea-90be-aecf4222ca4c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Creating offline snapshot 59212684-36da-49e0-8724-7a53ea71801e of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[267fae47-3e0e-4672-83e0-d988312b3d11]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:40 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD Sep 28 05:15:40 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:40 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Deleted volume successfully. Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3f00ab16-95ad-4b1a-832a-5d38165d928d tempest-VolumesListAdminTestJSON-765342718 None] Lock "cinder-ad077587-ec26-47a4-9754-a7cad8b2e8ee-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:40 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 Sep 28 05:15:40 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:40 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:40 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73" returned: 0 in 0.412s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:40 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e 1G Sep 28 05:15:40 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:40 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e 1G" returned: 0 in 0.391s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:40 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:15:40 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:41 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.302s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:41 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e is being set with open permissions: ugo+rw Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:41 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:15:41 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:41 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:41 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info Sep 28 05:15:41 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:41 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info" returned: 0 in 0.274s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:41 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info is being set with open permissions: ugo+rw Sep 28 05:15:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:41 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info Sep 28 05:15:41 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:42 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.info" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1451616551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af919f81-57b4-4a48-ad9f-5f339c5a9ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cdfefcf7bf4b36aed7c1a3a9c4dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:39Z,use_quota=True,user_id='745fb6e68f2e40b6a9e9b0d5c78e404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Creating volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:42 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:42 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1073741824 Sep 28 05:15:42 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-87017cf1-941d-4230-9e37-a3a9d732195c tempest-VolumesSnapshotListTestJSON-1904814838 None] Create snapshot completed successfully Sep 28 05:15:42 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1073741824" returned: 0 in 0.472s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:42 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 Sep 28 05:15:42 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:42 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.274s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Creating offline snapshot 362138e8-41e1-4a6c-8a09-7ef85de7f576 of volume d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Attempting download of 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed33844-a4fc-4f02-81da-95b0322c1817]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1926794-2e83-483b-ae65-2807c1187fc7]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:43 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed Sep 28 05:15:43 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:43 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj Sep 28 05:15:43 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:43 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj" returned: 0 in 0.444s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:43 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed" returned: 0 in 0.532s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 2G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:43 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 2G Sep 28 05:15:43 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:43 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj Sep 28 05:15:43 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:43 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj" returned: 1 in 0.413s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_3sqe5pjj' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c4b8d0-0d99-4a9f-a27d-b5d6dfa455f6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:44 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD Sep 28 05:15:44 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:44 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 2G" returned: 0 in 0.518s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:44 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 Sep 28 05:15:44 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:44 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] 1cf8d7db-9851-461c-94d0-a979c9e2e98b was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:44 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 Sep 28 05:15:44 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:44 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576" returned: 0 in 0.343s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:44 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 is being set with open permissions: ugo+rw Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:44 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 Sep 28 05:15:44 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:44 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576" returned: 0 in 0.296s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:44 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info Sep 28 05:15:44 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:45 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info" returned: 0 in 0.346s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:45 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info is being set with open permissions: ugo+rw Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:45 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info Sep 28 05:15:45 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:45 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.info" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.862s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Creating offline snapshot 2792a4bc-16b8-40e9-aa70-bb6c54198e9d of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-97cf41d7-fd34-4a26-912e-f59432ecd6b2 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Create snapshot completed successfully Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f99f3-82cf-45e0-a598-e5c2c4947a94]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:45 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:15:45 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:45 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:45 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d 1G Sep 28 05:15:45 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "cinder-362138e8-41e1-4a6c-8a09-7ef85de7f576-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-362138e8-41e1-4a6c-8a09-7ef85de7f576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "cinder-quobyte-362138e8-41e1-4a6c-8a09-7ef85de7f576" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-362138e8-41e1-4a6c-8a09-7ef85de7f576" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Deleting offline snapshot 362138e8-41e1-4a6c-8a09-7ef85de7f576 of volume d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] snapshot_file for this snap is: volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9257ebd3-04ed-4911-ae95-02dec2cf717c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:46 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 Sep 28 05:15:46 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" returned: 0 in 2.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_5dsk7v36devstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:15:46 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Converted 112.00 MB image at 49.79 MB/s Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:46 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d 1G" returned: 0 in 0.604s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:46 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1G Sep 28 05:15:46 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:46 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576" returned: 0 in 0.484s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da07f48-aa66-4e3f-9106-9bf964d6b212]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:46 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed Sep 28 05:15:46 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:46 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d is being set with open permissions: ugo+rw Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:46 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 1G" returned: 0 in 0.407s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Downloaded image 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6 successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b for user 745fb6e68f2e40b6a9e9b0d5c78e404d is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Marking volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6 as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:15:46 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:46 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Copying metadata from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b to af919f81-57b4-4a48-ad9f-5f339c5a9ed6. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:15:46 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Creating volume glance metadata for volume af919f81-57b4-4a48-ad9f-5f339c5a9ed6 backed by image 1cf8d7db-9851-461c-94d0-a979c9e2e98b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889ef49-2693-4f09-98ba-ce80e8c9a01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47247155-a6a3-40a5-af5d-9701cf3efebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Volume volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 (af919f81-57b4-4a48-ad9f-5f339c5a9ed6): created successfully Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47247155-a6a3-40a5-af5d-9701cf3efebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Flow 'volume_create_manager' (f5cdcc2c-4b0c-4ca1-bc8b-93c920ebe627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-50337efe-8977-4c2f-b2da-37d97b5b0870 tempest-TestShelveInstance-1234515147 None] Created volume successfully. Sep 28 05:15:47 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed" returned: 0 in 0.485s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:47 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 Sep 28 05:15:47 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:47 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ed157770-803b-4c3f-9264-eb1b989c998e tempest-VolumesSnapshotListTestJSON-1904814838 None] Create snapshot completed successfully Sep 28 05:15:47 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:47 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576 Sep 28 05:15:47 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Creating offline snapshot b5a4c8e7-b94d-4d95-82b5-5b0411216f4f of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:47 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed.362138e8-41e1-4a6c-8a09-7ef85de7f576" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8a0ee-4c5f-4165-9e94-985de0d0a050]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-362138e8-41e1-4a6c-8a09-7ef85de7f576" released by "_delete_snapshot" :: held 1.851s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" released by "delete_snapshot" :: held 1.881s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Created reservations ['59ee04fe-071b-4aef-ba26-1dd47e0ed586', '78b4f431-c222-4cb9-ad4b-f54bfdab3117', '7745d458-0a56-4b70-8ea7-db48ae204bab', 'b55a23b5-7cd7-40e3-be3d-9c2d28a535e0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:48 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:48 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Delete snapshot completed successfully. Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-48812db3-09b5-4127-9c9b-141470b820a9 tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-362138e8-41e1-4a6c-8a09-7ef85de7f576-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "cinder-d2a0be93-2072-4dc5-8b3d-ada8470650ed-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:48 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.441s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-d2a0be93-2072-4dc5-8b3d-ada8470650ed-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:48 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f 1G Sep 28 05:15:48 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" acquired by "delete_volume" :: waited 0.046s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba9f72-d961-426f-8e86-7dcf74fe4911]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:48 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed Sep 28 05:15:48 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:49 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:49 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed Sep 28 05:15:49 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:49 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f 1G" returned: 0 in 0.835s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:49 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f Sep 28 05:15:49 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:49 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d2a0be93-2072-4dc5-8b3d-ada8470650ed" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-quobyte-d2a0be93-2072-4dc5-8b3d-ada8470650ed" released by "delete_volume" :: held 0.948s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Created reservations ['fb462c1b-75cb-4e5d-837f-08fd9278e53d', 'f63c3391-5e97-4204-9b9d-7a7853df4d50', '91490a7d-b43d-4f0b-9644-916802ee407a', 'f02ac7cb-ecd6-443c-892c-1553789dfab9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:49 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" returned: 0 in 0.389s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:49 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f is being set with open permissions: ugo+rw Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:49 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f Sep 28 05:15:49 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:49 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:15:49 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:50 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:50 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:50 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:15:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-339a1249-4be0-4387-a9f5-21d7ed6f52ab tempest-VolumesSnapshotListTestJSON-1904814838 None] Create snapshot completed successfully Sep 28 05:15:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Deleted volume successfully. Sep 28 05:15:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-498ef248-bd3d-448b-a1bf-f53fc6bba63a tempest-VolumesSnapshotNegativeTestJSON-1907061417 None] Lock "cinder-d2a0be93-2072-4dc5-8b3d-ada8470650ed-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-f8107072-5c2d-4c2d-977b-72330657c5cb req-a2bb5817-cb67-4ec3-8a92-fe32307a22e7 tempest-TestShelveInstance-1234515147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-f8107072-5c2d-4c2d-977b-72330657c5cb req-a2bb5817-cb67-4ec3-8a92-fe32307a22e7 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-f8107072-5c2d-4c2d-977b-72330657c5cb req-a2bb5817-cb67-4ec3-8a92-fe32307a22e7 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-f8107072-5c2d-4c2d-977b-72330657c5cb req-a2bb5817-cb67-4ec3-8a92-fe32307a22e7 tempest-TestShelveInstance-1234515147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c12dd61a-b47d-44cc-b043-46b3d469fdb5', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:15:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-f8107072-5c2d-4c2d-977b-72330657c5cb req-a2bb5817-cb67-4ec3-8a92-fe32307a22e7 tempest-TestShelveInstance-1234515147 None] attachment_update completed successfully. Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Deleting offline snapshot b5a4c8e7-b94d-4d95-82b5-5b0411216f4f of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] snapshot_file for this snap is: volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:15:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ae9ab-cbbc-4e75-a5bb-c0e0a638b658]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:53 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f Sep 28 05:15:53 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:53 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" returned: 0 in 0.442s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a1f72-745c-44d1-b220-81105c897951]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:53 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:53 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:54 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.551s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:54 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f Sep 28 05:15:54 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:54 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" returned: 0 in 0.549s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:54 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f Sep 28 05:15:54 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:54 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" returned: 0 in 0.337s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f" released by "_delete_snapshot" :: held 2.113s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" released by "delete_snapshot" :: held 2.152s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Created reservations ['78240341-de16-45d8-a953-98cb113bab12', 'affa95f4-b611-4f00-a5b0-2200618539bc', '233313ce-c6bd-440a-a810-a70ec8c1847b', '9e81b8ee-1611-4510-8312-12c61ad1d8b5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Delete snapshot completed successfully. Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0a4ef474-c5d0-408d-94e3-a7c5a5d8a057 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-b5a4c8e7-b94d-4d95-82b5-5b0411216f4f-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (6c5897aa-f26a-4709-9a29-0fb989522845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a247a-1aed-426f-ab4d-8eda7fc6ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a247a-1aed-426f-ab4d-8eda7fc6ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-835097950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028b15be-0023-4440-a377-380737e5fbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba363270ba04acfa01d877b9bde0207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:55Z,use_quota=True,user_id='34cc90415bc04922b7513e4cc650a2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473fa2f1-42a7-48fd-9bd1-b0ef1235e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473fa2f1-42a7-48fd-9bd1-b0ef1235e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e853823-ba56-47ff-9cc9-61bc64b3dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e853823-ba56-47ff-9cc9-61bc64b3dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028b15be-0023-4440-a377-380737e5fbdf', 'volume_name': 'volume-028b15be-0023-4440-a377-380737e5fbdf', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c3a3f0-abca-4f7a-a6fc-de90b026dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c3a3f0-abca-4f7a-a6fc-de90b026dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc08a70-d444-45c2-b9e1-d001ce71d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Volume 028b15be-0023-4440-a377-380737e5fbdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028b15be-0023-4440-a377-380737e5fbdf', 'volume_size': 1} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-835097950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028b15be-0023-4440-a377-380737e5fbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba363270ba04acfa01d877b9bde0207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:15:55Z,use_quota=True,user_id='34cc90415bc04922b7513e4cc650a2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Creating volume 028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:15:55 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:15:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:55 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf 1073741824 Sep 28 05:15:55 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-2792a4bc-16b8-40e9-aa70-bb6c54198e9d-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-2792a4bc-16b8-40e9-aa70-bb6c54198e9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-2792a4bc-16b8-40e9-aa70-bb6c54198e9d" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:56 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-2792a4bc-16b8-40e9-aa70-bb6c54198e9d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Deleting offline snapshot 2792a4bc-16b8-40e9-aa70-bb6c54198e9d of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] snapshot_file for this snap is: volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf 1073741824" returned: 0 in 0.993s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed78d7-9d28-48fd-aa01-8bbca59b3247]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:56 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf Sep 28 05:15:56 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:56 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:56 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:57 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf" returned: 0 in 0.518s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc08a70-d444-45c2-b9e1-d001ce71d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028b15be-0023-4440-a377-380737e5fbdf', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafc4dea-7dbb-45a5-8235-7d95185f6d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:15:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Volume volume-028b15be-0023-4440-a377-380737e5fbdf (028b15be-0023-4440-a377-380737e5fbdf): created successfully Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafc4dea-7dbb-45a5-8235-7d95185f6d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (6c5897aa-f26a-4709-9a29-0fb989522845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:15:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4d169703-df21-454e-b417-625f984b8d32 tempest-VolumesDeleteCascade-1286944634 None] Created volume successfully. Sep 28 05:15:57 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.744s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d11a4-3f9e-40e0-83d4-a35ea9d1ec63]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:57 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:15:57 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Creating offline snapshot f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 of volume 028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51df0586-8fad-4dc9-ba65-10859eeb0dfc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:57 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.532s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:15:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:57 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:57 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:57 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf Sep 28 05:15:57 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:58 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf" returned: 0 in 0.491s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:58 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 1G Sep 28 05:15:58 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:58 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.519s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:58 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d Sep 28 05:15:58 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:58 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.2792a4bc-16b8-40e9-aa70-bb6c54198e9d" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-2792a4bc-16b8-40e9-aa70-bb6c54198e9d" released by "_delete_snapshot" :: held 2.288s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" released by "delete_snapshot" :: held 2.345s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Created reservations ['036b8978-a0c8-4eee-9619-c248f3032853', '253266af-290e-4560-a694-643ddcb223aa', 'ed23692e-4552-4b67-9372-7aa1c3614982', '02756e52-3843-4b1b-9262-03e8c429e703'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:15:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Delete snapshot completed successfully. Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-31349952-b45e-4fd4-b7f3-4a43b2244b85 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-2792a4bc-16b8-40e9-aa70-bb6c54198e9d-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:15:58 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 1G" returned: 0 in 0.719s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:58 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:15:58 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:59 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.496s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:15:59 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 is being set with open permissions: ugo+rw Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:15:59 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:15:59 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-59212684-36da-49e0-8724-7a53ea71801e-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-59212684-36da-49e0-8724-7a53ea71801e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-59212684-36da-49e0-8724-7a53ea71801e" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-59212684-36da-49e0-8724-7a53ea71801e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Deleting offline snapshot 59212684-36da-49e0-8724-7a53ea71801e of volume df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] snapshot_file for this snap is: volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b0c2e-e4a7-40fb-99ca-81b07cf28fdc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:15:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:00 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:00 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:16:00 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.637s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:00 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info Sep 28 05:16:00 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:00 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.602s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df64460d-48f2-4acd-b452-1091b18b3c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4268d2eb-0252-469d-a201-68cacdabd1f3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:00 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info" returned: 0 in 0.462s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:00 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info is being set with open permissions: ugo+rw Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:00 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info Sep 28 05:16:00 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:00 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 Sep 28 05:16:00 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:00 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.info" returned: 0 in 0.369s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.307s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1481d3c5-01a9-4676-a16b-12f237979fcb tempest-VolumesDeleteCascade-1286944634 None] Create snapshot completed successfully Sep 28 05:16:01 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73" returned: 0 in 0.642s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:01 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:16:01 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:01 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.572s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:01 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e Sep 28 05:16:01 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:02 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73.59212684-36da-49e0-8724-7a53ea71801e" returned: 0 in 0.569s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-59212684-36da-49e0-8724-7a53ea71801e" released by "_delete_snapshot" :: held 2.610s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" released by "delete_snapshot" :: held 2.683s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Creating offline snapshot 28ce91e9-00e3-4da6-a58c-692908c0157f of volume 028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78938a33-8cd4-4b0b-8957-324ad194c95d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Created reservations ['e113b123-fd70-4d0e-8b80-d9887239e0e7', '059e679e-13da-408e-a114-6e5340ab7041', '126a6d16-c7ba-4878-bc62-cfeb754a0562', '7ca062fc-1a50-448d-8584-a3f2879bc0c0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:02 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:16:02 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Delete snapshot completed successfully. Sep 28 05:16:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6b8372ba-8e5f-45e7-8e8e-2af977367905 tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-59212684-36da-49e0-8724-7a53ea71801e-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-df64460d-48f2-4acd-b452-1091b18b3c73-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-df64460d-48f2-4acd-b452-1091b18b3c73-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:03 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.773s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028b15be-0023-4440-a377-380737e5fbdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" acquired by "delete_volume" :: waited 0.072s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:03 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f 1G Sep 28 05:16:03 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba169f-aedf-4491-b568-45f8766df77b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:03 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 Sep 28 05:16:03 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:04 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73" returned: 0 in 0.747s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:04 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f 1G" returned: 0 in 0.989s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:04 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73 Sep 28 05:16:04 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:04 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f Sep 28 05:16:04 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:04 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-df64460d-48f2-4acd-b452-1091b18b3c73" returned: 0 in 0.592s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:04 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f" returned: 0 in 0.557s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:05 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f is being set with open permissions: ugo+rw Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-quobyte-df64460d-48f2-4acd-b452-1091b18b3c73" released by "delete_volume" :: held 1.535s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:05 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f Sep 28 05:16:05 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Created reservations ['e1ecfcb2-93fa-4253-aedd-9c2627a797bc', '62b6900b-212b-4961-8d2a-9d61264db88c', '64cb3b6a-7c9c-45f3-864f-659f8ea4183e', 'bfa13121-7dcb-407f-8f17-9b2359f5ff0d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:05 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:16:05 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:05 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f" returned: 0 in 0.448s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-568ce262-c559-4c77-ba52-d36d62505bf2 tempest-VolumesDeleteCascade-1286944634 None] Create snapshot completed successfully Sep 28 05:16:05 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.543s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:16:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Deleted volume successfully. Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-265af9ea-4e90-4c62-b54a-ea2abb75ef3d tempest-VolumesSnapshotListTestJSON-1904814838 None] Lock "cinder-df64460d-48f2-4acd-b452-1091b18b3c73-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-028b15be-0023-4440-a377-380737e5fbdf-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-028b15be-0023-4440-a377-380737e5fbdf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Performing cascade delete. {{(pid=86815) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-28ce91e9-00e3-4da6-a58c-692908c0157f-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-28ce91e9-00e3-4da6-a58c-692908c0157f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-28ce91e9-00e3-4da6-a58c-692908c0157f" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-28ce91e9-00e3-4da6-a58c-692908c0157f" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Deleting offline snapshot 28ce91e9-00e3-4da6-a58c-692908c0157f of volume 028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] snapshot_file for this snap is: volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1a1cf-2118-4a0b-95a3-071a8e26af94]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:06 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f Sep 28 05:16:06 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:07 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f" returned: 0 in 0.708s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028b15be-0023-4440-a377-380737e5fbdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd832135-0034-43fc-99bc-9c1bb7a55036]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:07 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:16:07 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:07 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.553s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028b15be-0023-4440-a377-380737e5fbdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:07 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f Sep 28 05:16:07 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:08 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f" returned: 0 in 0.613s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:08 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f Sep 28 05:16:08 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:08 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.28ce91e9-00e3-4da6-a58c-692908c0157f" returned: 0 in 0.462s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-28ce91e9-00e3-4da6-a58c-692908c0157f" released by "_delete_snapshot" :: held 2.556s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" released by "delete_snapshot" :: held 2.621s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=198,cinder:SELECT=154,cinder:DELETE=14,cinder:INSERT=52 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=133,cinder:INSERT=44,cinder:UPDATE=141,cinder:DELETE=16 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:16:08 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['5bad3fdd-220c-4164-b086-6e443ce9de88', '49de4979-9f6e-4422-ad98-babbeac2466b', '74f200e7-14e3-419e-b324-9dae352d5dc3', '3fd6ab57-dd98-4d2c-95b9-dca0086f22b0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Delete snapshot completed successfully. Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-28ce91e9-00e3-4da6-a58c-692908c0157f-delete_snapshot" released by "delete_snapshot" :: held 2.959s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Deleting offline snapshot f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 of volume 028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] snapshot_file for this snap is: volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc982e29-a9a1-44c1-944a-7cd3ebfcd82c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:09 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:16:09 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:09 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.587s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028b15be-0023-4440-a377-380737e5fbdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84910be6-ec69-4b55-81b3-3f6098302302]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:10 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf Sep 28 05:16:10 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:10 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf" returned: 0 in 0.532s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:10 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:16:10 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:10 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.504s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:10 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881 Sep 28 05:16:10 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:11 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf.f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" returned: 0 in 0.338s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881" released by "_delete_snapshot" :: held 2.111s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" released by "delete_snapshot" :: held 2.146s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['e9336182-fbf6-40e0-a44e-5cbb0176168a', 'e46682c2-5373-4179-8a41-1b4638e42e56', '5570f97b-3876-41ee-94e9-95c5a36d1e28', '7827d7c5-ef85-40d9-b4df-0078357f221d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Delete snapshot completed successfully. Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-f66cc5c0-a8b3-4dbe-b293-c3d413f1a881-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Snapshots deleted, issuing volume delete {{(pid=86815) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61fad4-58e2-4f08-96f5-83ee9b6d261a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:12 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf Sep 28 05:16:12 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:12 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf" returned: 0 in 0.625s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:12 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf Sep 28 05:16:12 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:12 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-028b15be-0023-4440-a377-380737e5fbdf" returned: 0 in 0.407s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-028b15be-0023-4440-a377-380737e5fbdf" released by "delete_volume" :: held 1.228s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:12 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['1351847b-feeb-48c9-9233-bf6fbfb5b6de', '23b5dea6-0aed-45b1-9fc4-ba10ecb6f876', '5a3599e9-3e68-4fbf-9ed9-bf98229828ad', '48f5885d-e5a6-4aee-b74c-bccddae0a361'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:13 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:16:13 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:13 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:16:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Deleted volume successfully. Sep 28 05:16:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-319ae326-5f11-4f04-a813-3a4139903df1 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-028b15be-0023-4440-a377-380737e5fbdf-delete_volume" released by "delete_volume" :: held 7.529s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (0a0757bc-83c9-4a5f-b16b-3d3cbfc0d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd125a-e4a3-4524-85c7-082f144ea8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd125a-e4a3-4524-85c7-082f144ea8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1991306733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb057bb-5515-432b-aab2-b7820d7d30ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba363270ba04acfa01d877b9bde0207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:15Z,use_quota=True,user_id='34cc90415bc04922b7513e4cc650a2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceecc1a-3b82-4501-b145-1d708ee16c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceecc1a-3b82-4501-b145-1d708ee16c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b360c31b-d469-436b-b50f-3c7fa8875e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b360c31b-d469-436b-b50f-3c7fa8875e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb057bb-5515-432b-aab2-b7820d7d30ef', 'volume_name': 'volume-bcb057bb-5515-432b-aab2-b7820d7d30ef', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956ab57-83f4-436d-a60e-2aef4b3a8316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956ab57-83f4-436d-a60e-2aef4b3a8316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2438ab-5462-4ead-a89e-21bfcdf37f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Volume bcb057bb-5515-432b-aab2-b7820d7d30ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb057bb-5515-432b-aab2-b7820d7d30ef', 'volume_size': 1} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1991306733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb057bb-5515-432b-aab2-b7820d7d30ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba363270ba04acfa01d877b9bde0207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:15Z,use_quota=True,user_id='34cc90415bc04922b7513e4cc650a2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Creating volume bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:16:15 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:16:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:15 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef 1073741824 Sep 28 05:16:15 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:16 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef 1073741824" returned: 0 in 0.671s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:16 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:16 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:16 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2438ab-5462-4ead-a89e-21bfcdf37f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb057bb-5515-432b-aab2-b7820d7d30ef', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362669a6-97bd-4401-aef4-bedfa089e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:16 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Volume volume-bcb057bb-5515-432b-aab2-b7820d7d30ef (bcb057bb-5515-432b-aab2-b7820d7d30ef): created successfully Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362669a6-97bd-4401-aef4-bedfa089e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (0a0757bc-83c9-4a5f-b16b-3d3cbfc0d0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-413808f6-ab72-4ccf-baae-0cceeba3858d tempest-VolumesDeleteCascade-1286944634 None] Created volume successfully. Sep 28 05:16:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Creating offline snapshot 4d5e4bf7-9701-4795-9c08-216cc682e319 of volume bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:16:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278b2c1-11b4-45f3-9397-08885bb713cb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:18 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:18 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:18 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:18 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 1G Sep 28 05:16:18 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:18 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 1G" returned: 0 in 0.535s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb057bb-5515-432b-aab2-b7820d7d30ef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:18 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb057bb-5515-432b-aab2-b7820d7d30ef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:18 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:19 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb057bb-5515-432b-aab2-b7820d7d30ef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:19 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 is being set with open permissions: ugo+rw Sep 28 05:16:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:19 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:19 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:19 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.347s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:19 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info Sep 28 05:16:19 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:20 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info" returned: 0 in 0.335s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:20 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info is being set with open permissions: ugo+rw Sep 28 05:16:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:20 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info Sep 28 05:16:20 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:20 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.info" returned: 0 in 0.275s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-193f8237-6e03-4626-9642-4392947d23f8 tempest-VolumesDeleteCascade-1286944634 None] Create snapshot completed successfully Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (e84666c7-ffd0-4448-b213-86b227ae5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6be932-e672-425e-9b95-20d24c94dcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6be932-e672-425e-9b95-20d24c94dcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-819408276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed01332-1cd3-4ea1-911c-1c137c5ca7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba363270ba04acfa01d877b9bde0207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d5e4bf7-9701-4795-9c08-216cc682e319,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:22Z,use_quota=True,user_id='34cc90415bc04922b7513e4cc650a2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce52aaa-273d-4883-be53-3d25c8f141b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce52aaa-273d-4883-be53-3d25c8f141b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596d0844-302f-4fd5-a3fb-5d5278e7c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596d0844-302f-4fd5-a3fb-5d5278e7c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ed01332-1cd3-4ea1-911c-1c137c5ca7bf', 'volume_name': 'volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf', 'volume_size': 1, 'snapshot_id': '4d5e4bf7-9701-4795-9c08-216cc682e319'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef5b6cc-1c39-4da3-94a7-f86871c48f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef5b6cc-1c39-4da3-94a7-f86871c48f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e7e8b2-42dd-4a33-8700-bc5f937dbf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Volume 6ed01332-1cd3-4ea1-911c-1c137c5ca7bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf', 'volume_size': 1, 'snapshot_id': '4d5e4bf7-9701-4795-9c08-216cc682e319'} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Creating volume 6ed01332-1cd3-4ea1-911c-1c137c5ca7bf from snapshot 4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] snapshot: 4d5e4bf7-9701-4795-9c08-216cc682e319, volume: 6ed01332-1cd3-4ea1-911c-1c137c5ca7bf, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72c64d-a1c9-4769-b300-1b61cda82db3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:22 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:22 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:22 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.579s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb057bb-5515-432b-aab2-b7820d7d30ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f54caf-fa4a-4920-92d3-b32bb7cc54d6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:22 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:22 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:22 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.447s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:16:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:22 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf Sep 28 05:16:22 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:29 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:16:29 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:30 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.641s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:16:30 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:16:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:16:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:16:31 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" returned: 0 in 8.793s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:31 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:16:31 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Converted 1024.00 MB image at 116.44 MB/s Sep 28 05:16:31 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf is being set with open permissions: ugo+rw Sep 28 05:16:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:31 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:INSERT=9,cinder:UPDATE=19,cinder:SELECT=20,cinder:DELETE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:16:31 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf Sep 28 05:16:31 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:31 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:16:32 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" returned: 0 in 0.286s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" released by "_copy_volume_from_snapshot" :: held 10.222s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" released by "_create_volume_from_snapshot" :: held 10.303s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.330s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e7e8b2-42dd-4a33-8700-bc5f937dbf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf', 'volume_size': 1, 'snapshot_id': '4d5e4bf7-9701-4795-9c08-216cc682e319'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69a88c5-d4ad-4b3e-a845-c2137640274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:32 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Volume volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf (6ed01332-1cd3-4ea1-911c-1c137c5ca7bf): created successfully Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69a88c5-d4ad-4b3e-a845-c2137640274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:32 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Flow 'volume_create_manager' (e84666c7-ffd0-4448-b213-86b227ae5c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f731bc58-64cf-4d70-9f38-4295e7c2ed58 tempest-VolumesDeleteCascade-1286944634 None] Created volume successfully. Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-bcb057bb-5515-432b-aab2-b7820d7d30ef-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-bcb057bb-5515-432b-aab2-b7820d7d30ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Performing cascade delete. {{(pid=86815) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-4d5e4bf7-9701-4795-9c08-216cc682e319-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-4d5e4bf7-9701-4795-9c08-216cc682e319-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Deleting offline snapshot 4d5e4bf7-9701-4795-9c08-216cc682e319 of volume bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] snapshot_file for this snap is: volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[824751d1-adcb-4a37-a7b2-45cb38e39322]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:33 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:33 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:33 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.534s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb057bb-5515-432b-aab2-b7820d7d30ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[49012aea-543b-4fd1-8501-6614d1dad2ed]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:34 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:34 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:34 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.824s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:34 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:34 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:35 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.436s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:35 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319 Sep 28 05:16:35 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:35 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef.4d5e4bf7-9701-4795-9c08-216cc682e319" returned: 0 in 0.347s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-4d5e4bf7-9701-4795-9c08-216cc682e319" released by "_delete_snapshot" :: held 2.319s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" released by "delete_snapshot" :: held 2.351s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['e918b0cc-db39-4d96-bd7b-2730611a1404', 'ef2159bb-1495-4774-8de9-f8b12607521c', '5874b2ec-339c-4a8f-b6d1-64910d69d41a', 'f78591dd-a6ff-4287-948a-12a2b38fab9d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Delete snapshot completed successfully. Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-4d5e4bf7-9701-4795-9c08-216cc682e319-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Snapshots deleted, issuing volume delete {{(pid=86815) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c006f3-4861-4944-86ba-c759e0a6d7ac]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:36 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:36 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:36 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.478s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:36 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef Sep 28 05:16:36 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:36 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bcb057bb-5515-432b-aab2-b7820d7d30ef" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-bcb057bb-5515-432b-aab2-b7820d7d30ef" released by "delete_volume" :: held 0.970s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:36 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['4a8201a5-8d2a-40cc-9890-cefe486a4410', '7fae804c-7de1-48a7-86ef-e08799c10c50', '2bb2c498-91ec-4c82-b930-84925e15fe96', '79e99105-53d3-4908-b68c-d06c928b3d74'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:37 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:16:37 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:37 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:16:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Deleted volume successfully. Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b300fcc7-1e8b-4f3e-a276-9b73eb83007e tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-bcb057bb-5515-432b-aab2-b7820d7d30ef-delete_volume" released by "delete_volume" :: held 4.484s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:16:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[777fa97d-39a0-43d5-aa83-3bb3f1ee0e55]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:38 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf Sep 28 05:16:38 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:38 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" returned: 0 in 0.501s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:38 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf Sep 28 05:16:38 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:38 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-quobyte-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf" released by "delete_volume" :: held 0.933s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:38 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Created reservations ['29d94aa5-d44a-4a25-b93c-be5c966f62a8', '12127f36-a9f8-4729-86c2-a470a3a45d12', '92093731-5aff-4e55-94c9-d4916a5ca271', '8d795fdc-b3da-44e5-93ec-d36a9410d3e7'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:39 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:16:39 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:39 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.412s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:16:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Deleted volume successfully. Sep 28 05:16:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f064398d-c96f-41fe-b4f1-5888981a8217 tempest-VolumesDeleteCascade-1286944634 None] Lock "cinder-6ed01332-1cd3-4ea1-911c-1c137c5ca7bf-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Flow 'volume_create_manager' (f23605a2-e5c2-4836-8757-268aad554e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2f0a4-c7eb-4230-9423-481465f2c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2f0a4-c7eb-4230-9423-481465f2c465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-369870734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc3aa3e-f5ff-4762-ba4d-3f209caef381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcdb3fea92346f683492dc96164902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:40Z,use_quota=True,user_id='95d8ec07293947689469223e3b7f9fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa36ea-448b-4586-9f90-b2167f9d6077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fa36ea-448b-4586-9f90-b2167f9d6077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599bf6c7-c329-46d2-b5fe-f32fc082a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599bf6c7-c329-46d2-b5fe-f32fc082a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc3aa3e-f5ff-4762-ba4d-3f209caef381', 'volume_name': 'volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e79d388-2afa-4cfa-bf8e-2d7afa23f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e79d388-2afa-4cfa-bf8e-2d7afa23f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d38151-da69-4a2f-91d6-6eb462a32b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:40 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Volume 7fc3aa3e-f5ff-4762-ba4d-3f209caef381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381', 'volume_size': 1} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-369870734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc3aa3e-f5ff-4762-ba4d-3f209caef381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcdb3fea92346f683492dc96164902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:40Z,use_quota=True,user_id='95d8ec07293947689469223e3b7f9fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Creating volume 7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:16:40 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:16:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:40 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 1073741824 Sep 28 05:16:40 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (42985ca0-ff5b-4f9a-bba6-4ce216ffc697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffeb5db-5616-4244-ab99-7b65c83084fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffeb5db-5616-4244-ab99-7b65c83084fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1626790866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2b3655-d036-4b1b-8551-fe93ebd7e2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:41Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(509e8f95-272a-44a8-8698-ea64f88c778e),volume_type_id=509e8f95-272a-44a8-8698-ea64f88c778e)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a17805b-17f8-48d0-954a-8d52657e0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a17805b-17f8-48d0-954a-8d52657e0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089a44e0-f9b9-45ae-98b8-cf67ccc1fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089a44e0-f9b9-45ae-98b8-cf67ccc1fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2b3655-d036-4b1b-8551-fe93ebd7e2c1', 'volume_name': 'volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d11b102-f93a-425f-aa78-32fd46e63351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d11b102-f93a-425f-aa78-32fd46e63351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fd533-85b0-433a-b999-bd211b3504f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:41 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Volume 7b2b3655-d036-4b1b-8551-fe93ebd7e2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1', 'volume_size': 1} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:41 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 1073741824" returned: 0 in 0.925s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:41 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:16:41 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (4ab33056-14de-4d04-9177-b46f395a9683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6485d13-ba97-491f-ab34-f500400cc1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6485d13-ba97-491f-ab34-f500400cc1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-18527302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d66a85-2f07-46bf-bba3-54b86c92969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:42Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a7fe027-e083-42ee-9286-f0df40ab4a39),volume_type_id=3a7fe027-e083-42ee-9286-f0df40ab4a39)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197063b-6c01-4e9d-9337-2a549b7a5e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197063b-6c01-4e9d-9337-2a549b7a5e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d73e0b-8796-4bad-ab6f-e121bf1b8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d73e0b-8796-4bad-ab6f-e121bf1b8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d66a85-2f07-46bf-bba3-54b86c92969c', 'volume_name': 'volume-28d66a85-2f07-46bf-bba3-54b86c92969c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122c28d-1de1-402f-b079-4d035e58a706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122c28d-1de1-402f-b079-4d035e58a706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0eaf5-e46c-4b08-a9d1-42f83f96feb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume 28d66a85-2f07-46bf-bba3-54b86c92969c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d66a85-2f07-46bf-bba3-54b86c92969c', 'volume_size': 1} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-c01d9c36-d201-4164-bc2a-7701a86036d3 req-f0bc3df6-5e0a-4b81-a9d9-f98e53164873 tempest-TestShelveInstance-1234515147 None] Terminate volume connection completed successfully. Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-c01d9c36-d201-4164-bc2a-7701a86036d3 req-f0bc3df6-5e0a-4b81-a9d9-f98e53164873 tempest-TestShelveInstance-1234515147 None] Deleting attachment c12dd61a-b47d-44cc-b043-46b3d469fdb5. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:16:42 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.554s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1626790866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2b3655-d036-4b1b-8551-fe93ebd7e2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:41Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(509e8f95-272a-44a8-8698-ea64f88c778e),volume_type_id=509e8f95-272a-44a8-8698-ea64f88c778e)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Creating volume 7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:16:42 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d38151-da69-4a2f-91d6-6eb462a32b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eee969e-f69b-40c7-8cfa-e07d28e8e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:42 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 1073741824 Sep 28 05:16:42 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Volume volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 (7fc3aa3e-f5ff-4762-ba4d-3f209caef381): created successfully Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eee969e-f69b-40c7-8cfa-e07d28e8e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Flow 'volume_create_manager' (f23605a2-e5c2-4836-8757-268aad554e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bce7dcd8-6896-472e-82e7-7c7d7dad9287 tempest-TestImageHashVerification-1571163709 None] Created volume successfully. Sep 28 05:16:43 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 1073741824" returned: 0 in 0.994s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:43 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 Sep 28 05:16:43 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (283ba912-4d6e-43d6-9c09-117feb8fc09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c31169-9bda-4f6c-9dcc-7e487a82a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c31169-9bda-4f6c-9dcc-7e487a82a116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-331472102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb28f9-3943-40e8-ab94-0bda5bc7f7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:44Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53f730-61e6-407c-88a4-6614d07d788f),volume_type_id=9d53f730-61e6-407c-88a4-6614d07d788f)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69328a00-3b77-45ff-919a-4979a243b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69328a00-3b77-45ff-919a-4979a243b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fa50e4-af11-46b1-b597-45d019cb52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:16:43 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" returned: 0 in 0.441s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-18527302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d66a85-2f07-46bf-bba3-54b86c92969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:42Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a7fe027-e083-42ee-9286-f0df40ab4a39),volume_type_id=3a7fe027-e083-42ee-9286-f0df40ab4a39)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Creating volume 28d66a85-2f07-46bf-bba3-54b86c92969c {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:16:43 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fd533-85b0-433a-b999-bd211b3504f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:43 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c 1073741824 Sep 28 05:16:43 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434b784-8955-4c55-94eb-4a3cf327af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:43 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Volume volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 (7b2b3655-d036-4b1b-8551-fe93ebd7e2c1): created successfully Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434b784-8955-4c55-94eb-4a3cf327af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (42985ca0-ff5b-4f9a-bba6-4ce216ffc697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9f5936e0-b539-4f0a-9b84-9132b234b8cf tempest-TestInstancesWithCinderVolumes-369834342 None] Created volume successfully. Sep 28 05:16:44 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c 1073741824" returned: 0 in 0.585s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fa50e4-af11-46b1-b597-45d019cb52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86eb28f9-3943-40e8-ab94-0bda5bc7f7d0', 'volume_name': 'volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0', 'volume_size': 1, 'image_id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1507634725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0377ea933a84bb8980f0ae2de8f78f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'created_at': datetime.datetime(2026, 9, 28, 3, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bbe3b249-e950-41df-a9d5-933fc3b81548/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7644abf3-dff6-40ec-ad58-7513438f5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7644abf3-dff6-40ec-ad58-7513438f5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956dffd9-b9da-4889-8022-35392757f636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0', 'volume_size': 1, 'image_id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1507634725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0377ea933a84bb8980f0ae2de8f78f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'created_at': datetime.datetime(2026, 9, 28, 3, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bbe3b249-e950-41df-a9d5-933fc3b81548/file', 'properties': {}}, 'image_service': } Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Trying to clone 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 from image bbe3b249-e950-41df-a9d5-933fc3b81548 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:44 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c Sep 28 05:16:44 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:44 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c" returned: 0 in 0.378s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.253s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0eaf5-e46c-4b08-a9d1-42f83f96feb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d66a85-2f07-46bf-bba3-54b86c92969c', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009ee6f1-4e12-43b4-8e82-9cf3776ecf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aa3bbc-a79d-4196-960e-3099360bd5f2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume volume-28d66a85-2f07-46bf-bba3-54b86c92969c (28d66a85-2f07-46bf-bba3-54b86c92969c): created successfully Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009ee6f1-4e12-43b4-8e82-9cf3776ecf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (4ab33056-14de-4d04-9177-b46f395a9683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-958e9667-83ab-4977-a3b8-5ae4c59b1734 tempest-TestInstancesWithCinderVolumes-369834342 None] Created volume successfully. Sep 28 05:16:45 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:16:45 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:45 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.489s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8105c-bc9e-4801-9bae-cbd1b2761de4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:45 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:16:45 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:46 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.497s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 /opt/stack/data/cinder/conversion/7fc3aa3e-f5ff-4762-ba4d-3f209caef381.temp_image.b4f7e55a-24ed-40c6-8367-14c13a44b3d6cd7l9xu1.img {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:46 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 /opt/stack/data/cinder/conversion/7fc3aa3e-f5ff-4762-ba4d-3f209caef381.temp_image.b4f7e55a-24ed-40c6-8367-14c13a44b3d6cd7l9xu1.img Sep 28 05:16:46 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-1460c149-c360-499e-84fb-40832f7b360b req-2e2b3891-7557-47d5-bb8f-648bd28152b8 tempest-TestShelveInstance-1234515147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Flow 'volume_create_manager' (3a446344-6003-432b-a959-921aad8930ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1c2880-1cb7-4320-8a32-0335ae3147a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1c2880-1cb7-4320-8a32-0335ae3147a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1190270655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39537fa7-30c5-4111-8e54-eced6c5daef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4086e0d90944b4a1ffa558a69ccecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:49Z,use_quota=True,user_id='31c09da19dc444ad9e42ded1c8559704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3482bf0-7d55-4df1-8d30-3e6f0875b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3482bf0-7d55-4df1-8d30-3e6f0875b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87de3c19-a747-406b-8bac-50e70dd82cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87de3c19-a747-406b-8bac-50e70dd82cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39537fa7-30c5-4111-8e54-eced6c5daef3', 'volume_name': 'volume-39537fa7-30c5-4111-8e54-eced6c5daef3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbaf7d0-e91b-4205-b1cd-f2a0852e3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbaf7d0-e91b-4205-b1cd-f2a0852e3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5c4bde-f919-4c1c-b403-7fd6a276e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:16:49 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Volume 39537fa7-30c5-4111-8e54-eced6c5daef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39537fa7-30c5-4111-8e54-eced6c5daef3', 'volume_size': 1} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:49 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD, size 20.69 MB, duration 5.44 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:16:49 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Image download 20.69 MB at 3.80 MB/s Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e415e-2863-4057-872f-0911f686864c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:50 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD Sep 28 05:16:50 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:50 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Temporary image bbe3b249-e950-41df-a9d5-933fc3b81548 is fetched for user da5200db6bb94ea8b3eabe1f76fa4cf1. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53de41-ac81-4022-8b5e-23c4921861e2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:50 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD Sep 28 05:16:50 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:51 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:16:53 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 /opt/stack/data/cinder/conversion/7fc3aa3e-f5ff-4762-ba4d-3f209caef381.temp_image.b4f7e55a-24ed-40c6-8367-14c13a44b3d6cd7l9xu1.img" returned: 0 in 7.552s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48540367-f64f-4a78-bd13-c95be9aa2f38]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:16:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:16:53 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:16:53 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:16:54 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 28 05:16:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.530s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:16:54 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/conversion/7fc3aa3e-f5ff-4762-ba4d-3f209caef381.temp_image.b4f7e55a-24ed-40c6-8367-14c13a44b3d6cd7l9xu1.img {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:16:54 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Converted 1024.00 MB image at 135.58 MB/s Sep 28 05:16:54 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] b4f7e55a-24ed-40c6-8367-14c13a44b3d6 was raw, no need to convert to raw {{(pid=86815) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 05:17:04 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=35,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:17:04 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=39,cinder:SELECT=25,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.772s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Uploaded volume to glance image-id: b4f7e55a-24ed-40c6-8367-14c13a44b3d6. {{(pid=86815) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-1460c149-c360-499e-84fb-40832f7b360b req-2e2b3891-7557-47d5-bb8f-648bd28152b8 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.740s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-1460c149-c360-499e-84fb-40832f7b360b req-2e2b3891-7557-47d5-bb8f-648bd28152b8 tempest-TestShelveInstance-1234515147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.300s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1190270655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39537fa7-30c5-4111-8e54-eced6c5daef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4086e0d90944b4a1ffa558a69ccecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:49Z,use_quota=True,user_id='31c09da19dc444ad9e42ded1c8559704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Creating volume 39537fa7-30c5-4111-8e54-eced6c5daef3 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:17:12 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dc4dc33f-614a-4ef6-baa5-05e9a870d86a tempest-TestImageHashVerification-1571163709 None] Copy volume to image completed successfully. Sep 28 05:17:12 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 1073741824 Sep 28 05:17:12 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-1460c149-c360-499e-84fb-40832f7b360b req-2e2b3891-7557-47d5-bb8f-648bd28152b8 tempest-TestShelveInstance-1234515147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25d2fd59-8001-402c-9b0d-d2fa6d16464e', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:17:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-1460c149-c360-499e-84fb-40832f7b360b req-2e2b3891-7557-47d5-bb8f-648bd28152b8 tempest-TestShelveInstance-1234515147 None] attachment_update completed successfully. Sep 28 05:17:13 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 1073741824" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:13 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 Sep 28 05:17:13 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Acquiring lock "cinder-7fc3aa3e-f5ff-4762-ba4d-3f209caef381-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "cinder-7fc3aa3e-f5ff-4762-ba4d-3f209caef381-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Acquiring lock "cinder-quobyte-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "cinder-quobyte-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed37859c-a84b-4d56-a279-4af26f608fe9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:13 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3" returned: 0 in 0.351s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.451s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-331472102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eb28f9-3943-40e8-ab94-0bda5bc7f7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0377ea933a84bb8980f0ae2de8f78f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:16:44Z,use_quota=True,user_id='da5200db6bb94ea8b3eabe1f76fa4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53f730-61e6-407c-88a4-6614d07d788f),volume_type_id=9d53f730-61e6-407c-88a4-6614d07d788f)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Creating volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:17:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5c4bde-f919-4c1c-b403-7fd6a276e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39537fa7-30c5-4111-8e54-eced6c5daef3', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:13 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1073741824 Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16db4187-2d5d-4ecd-8566-46a91a8c0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:13 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:13 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:17:13 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Volume volume-39537fa7-30c5-4111-8e54-eced6c5daef3 (39537fa7-30c5-4111-8e54-eced6c5daef3): created successfully Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16db4187-2d5d-4ecd-8566-46a91a8c0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Flow 'volume_create_manager' (3a446344-6003-432b-a959-921aad8930ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b021d7a5-052c-489c-80a8-5edc6f914efb tempest-VolumesTransfersTest-1153424574 None] Created volume successfully. Sep 28 05:17:14 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.510s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:14 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381 Sep 28 05:17:14 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:14 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1073741824" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:14 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 Sep 28 05:17:14 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:14 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "cinder-quobyte-7fc3aa3e-f5ff-4762-ba4d-3f209caef381" released by "delete_volume" :: held 0.873s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Created reservations ['4a46afe3-acbb-4377-98d5-1904447c1bcd', '6218e9f4-2e24-41b2-94fa-bff59a929867', '66026a18-0aab-45cd-aae9-340fcb8c5b06', 'df8305e4-5ca4-4143-9b87-370c637e7c1e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:14 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:14 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:17:14 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Attempting download of bbe3b249-e950-41df-a9d5-933fc3b81548 ((None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}])) to volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8dbc9c-657c-4bc3-bda8-2d82972dd65b]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:14 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng Sep 28 05:17:14 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:14 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.350s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:17:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Deleted volume successfully. Sep 28 05:17:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-882a856f-9ca7-4e94-b6d1-104d1138273f tempest-TestImageHashVerification-1571163709 None] Lock "cinder-7fc3aa3e-f5ff-4762-ba4d-3f209caef381-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:15 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng" returned: 0 in 0.524s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:15 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng Sep 28 05:17:15 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:15 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng" returned: 1 in 0.453s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bbe3b249-e950-41df-a9d5-933fc3b81548_ql5iksng' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1624da-1230-4420-b58b-241732771360]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:15 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD Sep 28 05:17:15 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6507750f-5a2f-49b7-b722-6ec9aff8cc79 tempest-VolumesTransfersTest-115652764 None] Transfer volume completed successfully. Sep 28 05:17:16 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:16 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] bbe3b249-e950-41df-a9d5-933fc3b81548 was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:17:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:16 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 Sep 28 05:17:16 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Acquiring lock "cinder-39537fa7-30c5-4111-8e54-eced6c5daef3-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "cinder-39537fa7-30c5-4111-8e54-eced6c5daef3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Acquiring lock "cinder-quobyte-39537fa7-30c5-4111-8e54-eced6c5daef3" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "cinder-quobyte-39537fa7-30c5-4111-8e54-eced6c5daef3" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6639f807-668c-4b9e-95fc-30a1fa02c0b6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:17 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 Sep 28 05:17:17 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:17 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3" returned: 0 in 0.649s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:17 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3 Sep 28 05:17:17 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:18 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39537fa7-30c5-4111-8e54-eced6c5daef3" returned: 0 in 0.487s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "cinder-quobyte-39537fa7-30c5-4111-8e54-eced6c5daef3" released by "delete_volume" :: held 1.246s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Created reservations ['1051b1ba-8e46-4345-aedf-8334640cb18b', '6c1ace47-8db0-4a95-b674-9c25215bdd1e', 'ec2311eb-100b-448a-970f-fb60f5d40240', 'ea97dbe1-8951-4e80-b913-03e0545ab070'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:18 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:17:18 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:18 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:17:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Deleted volume successfully. Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08d2867f-5680-4787-bc4f-4adae93d130c tempest-VolumesTransfersTest-590058150 None] Lock "cinder-39537fa7-30c5-4111-8e54-eced6c5daef3-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:19 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" returned: 0 in 3.097s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bbe3b249-e950-41df-a9d5-933fc3b81548_5s2x968jdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:17:19 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Converted 112.00 MB image at 36.15 MB/s Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:19 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1G Sep 28 05:17:19 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:19 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 1G" returned: 0 in 0.477s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Downloaded image bbe3b249-e950-41df-a9d5-933fc3b81548 ((None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}])) to volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Temporary image bbe3b249-e950-41df-a9d5-933fc3b81548 for user da5200db6bb94ea8b3eabe1f76fa4cf1 is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Marking volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Copying metadata from image bbe3b249-e950-41df-a9d5-933fc3b81548 to 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Creating volume glance metadata for volume 86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 backed by image bbe3b249-e950-41df-a9d5-933fc3b81548 with: {'image_id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'image_name': 'tempest-scenario-img--1507634725', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956dffd9-b9da-4889-8022-35392757f636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0', 'volume_size': 1, 'image_id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bbe3b249-e950-41df-a9d5-933fc3b81548', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1507634725', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e0377ea933a84bb8980f0ae2de8f78f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bbe3b249-e950-41df-a9d5-933fc3b81548', 'created_at': datetime.datetime(2026, 9, 28, 3, 16, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bbe3b249-e950-41df-a9d5-933fc3b81548/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6c7717-a59e-4011-ae24-9e1ddd3a2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:19 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Flow 'volume_create_manager' (388667e8-fabb-404c-a8d3-01e876a36630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6aec5d-0d99-4b9a-a9c0-0676b7e61bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Volume volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 (86eb28f9-3943-40e8-ab94-0bda5bc7f7d0): created successfully Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6c7717-a59e-4011-ae24-9e1ddd3a2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Flow 'volume_create_manager' (283ba912-4d6e-43d6-9c09-117feb8fc09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6aec5d-0d99-4b9a-a9c0-0676b7e61bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1696303238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5eda5c-4881-4a50-b7d0-473754a03ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4086e0d90944b4a1ffa558a69ccecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:20Z,use_quota=True,user_id='31c09da19dc444ad9e42ded1c8559704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff16a07-50c8-4771-bdfa-e8bd35f7b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff16a07-50c8-4771-bdfa-e8bd35f7b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e6d5d7-d6ab-4648-9cc7-1062a149063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e6d5d7-d6ab-4648-9cc7-1062a149063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5eda5c-4881-4a50-b7d0-473754a03ea5', 'volume_name': 'volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8fcbc7-6e6d-47df-982d-9a6930bb9f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8fcbc7-6e6d-47df-982d-9a6930bb9f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6789ed46-eb3d-48bf-87b1-a5eb890ae03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Volume 4c5eda5c-4881-4a50-b7d0-473754a03ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5', 'volume_size': 1} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1696303238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5eda5c-4881-4a50-b7d0-473754a03ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4086e0d90944b4a1ffa558a69ccecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:20Z,use_quota=True,user_id='31c09da19dc444ad9e42ded1c8559704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Creating volume 4c5eda5c-4881-4a50-b7d0-473754a03ea5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:17:20 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5b728a76-a6ec-43fe-9abb-8d6e354fb038 tempest-TestInstancesWithCinderVolumes-369834342 None] Created volume successfully. Sep 28 05:17:20 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 1073741824 Sep 28 05:17:20 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:20 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 1073741824" returned: 0 in 0.750s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:21 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 Sep 28 05:17:21 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:21 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6789ed46-eb3d-48bf-87b1-a5eb890ae03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afca607-6deb-4a56-8f4d-e52686e2b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Volume volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 (4c5eda5c-4881-4a50-b7d0-473754a03ea5): created successfully Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afca607-6deb-4a56-8f4d-e52686e2b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Flow 'volume_create_manager' (388667e8-fabb-404c-a8d3-01e876a36630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6e619f31-83d0-4a61-a561-de7d2bb304f5 tempest-VolumesTransfersTest-1153424574 None] Created volume successfully. Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Acquiring lock "cinder-4c5eda5c-4881-4a50-b7d0-473754a03ea5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "cinder-4c5eda5c-4881-4a50-b7d0-473754a03ea5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Acquiring lock "cinder-quobyte-4c5eda5c-4881-4a50-b7d0-473754a03ea5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "cinder-quobyte-4c5eda5c-4881-4a50-b7d0-473754a03ea5" acquired by "delete_volume" :: waited 0.091s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75f6d4-614b-4e4b-84fc-f4b81c5ad954]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:23 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 Sep 28 05:17:23 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:23 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5" returned: 0 in 0.532s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:23 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5 Sep 28 05:17:23 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:23 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c5eda5c-4881-4a50-b7d0-473754a03ea5" returned: 0 in 0.411s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "cinder-quobyte-4c5eda5c-4881-4a50-b7d0-473754a03ea5" released by "delete_volume" :: held 1.048s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Created reservations ['78876817-9c25-4ffc-a76e-f04e5f46fc0b', 'b4015294-2450-4909-acdc-f97ab1f6ad87', '0ad96837-7342-4600-afa4-64c8916561b7', '9045900f-f766-4734-ae87-d84d3270d89c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:24 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:17:24 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:24 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:17:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Deleted volume successfully. Sep 28 05:17:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1fbf59f8-0dc9-48db-a45e-a131f699b410 tempest-VolumesTransfersTest-590058150 None] Lock "cinder-4c5eda5c-4881-4a50-b7d0-473754a03ea5-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6fb5f2e9-4821-4bba-9ea3-f49748ee2b7f req-35bb8dab-70e2-42b1-a236-30e570d43597 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6fb5f2e9-4821-4bba-9ea3-f49748ee2b7f req-35bb8dab-70e2-42b1-a236-30e570d43597 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-6fb5f2e9-4821-4bba-9ea3-f49748ee2b7f req-35bb8dab-70e2-42b1-a236-30e570d43597 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-6fb5f2e9-4821-4bba-9ea3-f49748ee2b7f req-35bb8dab-70e2-42b1-a236-30e570d43597 tempest-TestInstancesWithCinderVolumes-369834342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcf0ae15-bee4-47e2-a705-94145d7338b4', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:17:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-6fb5f2e9-4821-4bba-9ea3-f49748ee2b7f req-35bb8dab-70e2-42b1-a236-30e570d43597 tempest-TestInstancesWithCinderVolumes-369834342 None] attachment_update completed successfully. Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:29 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:17:29 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:30 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.732s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:17:30 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:17:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:17:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:17:35 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=44,cinder:UPDATE=32,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:17:35 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=42,cinder:SELECT=29,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Flow 'volume_create_manager' (c848ee00-12b8-476f-84d7-e6d621edb46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab476af2-2ce0-4a8f-bb9b-89e86eb5092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab476af2-2ce0-4a8f-bb9b-89e86eb5092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1870195427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b996569d-c96d-4420-a095-510851aeb0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7aa90c2569407aa2b8946a0d8aa681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:38Z,use_quota=True,user_id='e621770a7aa543af8c57cd0e9a589adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dcaf9c-48ae-42a0-abf3-557166aed9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dcaf9c-48ae-42a0-abf3-557166aed9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f763a3-0dec-4bc6-b7a1-235780838509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:37 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f763a3-0dec-4bc6-b7a1-235780838509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b996569d-c96d-4420-a095-510851aeb0fd', 'volume_name': 'volume-b996569d-c96d-4420-a095-510851aeb0fd', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2db96c-8972-4dba-ae26-537e47902a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2db96c-8972-4dba-ae26-537e47902a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4988867e-be16-466c-8143-8a885a7d4b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Volume b996569d-c96d-4420-a095-510851aeb0fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b996569d-c96d-4420-a095-510851aeb0fd', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Trying to clone b996569d-c96d-4420-a095-510851aeb0fd from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:17:38 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Image download 20.69 MB at 20.69 MB/s Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1e033-2df1-472c-bac5-7dcc20f4cca1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:39 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD Sep 28 05:17:39 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:39 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:39 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b is fetched for user e621770a7aa543af8c57cd0e9a589adc. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:17:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[021cac05-cfc3-47b3-b038-7dd48e2f4643]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:39 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD Sep 28 05:17:39 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:40 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD" returned: 0 in 0.706s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1870195427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b996569d-c96d-4420-a095-510851aeb0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7aa90c2569407aa2b8946a0d8aa681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:38Z,use_quota=True,user_id='e621770a7aa543af8c57cd0e9a589adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Creating volume b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:17:40 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:40 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1073741824 Sep 28 05:17:40 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:40 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1073741824" returned: 0 in 0.679s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:41 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd Sep 28 05:17:41 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:41 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Attempting download of 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume b996569d-c96d-4420-a095-510851aeb0fd. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef04c375-61ff-4ef8-8a3a-baeda03ec29c]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:41 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097 Sep 28 05:17:41 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:41 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097" returned: 0 in 0.498s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:42 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097 Sep 28 05:17:42 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:42 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097" returned: 1 in 0.421s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_luuyc097' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e275c0-f628-4605-9d8c-45f57e4b49fc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:42 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD Sep 28 05:17:42 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:42 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD" returned: 0 in 0.591s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] 1cf8d7db-9851-461c-94d0-a979c9e2e98b was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:17:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:43 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd Sep 28 05:17:43 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:46 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd" returned: 0 in 3.088s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_1lxu0364devstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:17:46 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Converted 112.00 MB image at 36.26 MB/s Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:46 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1G Sep 28 05:17:46 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:46 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 1G" returned: 0 in 0.461s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Downloaded image 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume b996569d-c96d-4420-a095-510851aeb0fd successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b for user e621770a7aa543af8c57cd0e9a589adc is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Marking volume b996569d-c96d-4420-a095-510851aeb0fd as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Copying metadata from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b to b996569d-c96d-4420-a095-510851aeb0fd. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Creating volume glance metadata for volume b996569d-c96d-4420-a095-510851aeb0fd backed by image 1cf8d7db-9851-461c-94d0-a979c9e2e98b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4988867e-be16-466c-8143-8a885a7d4b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b996569d-c96d-4420-a095-510851aeb0fd', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b5ed8-f33c-4667-a330-d02a43c6af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:46 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Volume volume-b996569d-c96d-4420-a095-510851aeb0fd (b996569d-c96d-4420-a095-510851aeb0fd): created successfully Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b5ed8-f33c-4667-a330-d02a43c6af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Flow 'volume_create_manager' (c848ee00-12b8-476f-84d7-e6d621edb46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b83d0277-f9aa-488f-805b-e7c62637b770 tempest-VolumesExtendTest-289656784 None] Created volume successfully. Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46d182-40bb-4170-b506-93127eb628c8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:48 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd Sep 28 05:17:48 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:48 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 2G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd 2G" returned: 0 in 0.126s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.626s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c76086e3-f885-4b12-855a-629d2e3b217b tempest-VolumesExtendTest-289656784 None] Extend volume completed successfully. Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-b996569d-c96d-4420-a095-510851aeb0fd-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "cinder-b996569d-c96d-4420-a095-510851aeb0fd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-quobyte-b996569d-c96d-4420-a095-510851aeb0fd" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-b996569d-c96d-4420-a095-510851aeb0fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175a785-ee4d-4a7c-9ba3-9c3f0479ecf0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:49 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd Sep 28 05:17:49 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:50 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd" returned: 0 in 0.449s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:50 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd Sep 28 05:17:50 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:50 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b996569d-c96d-4420-a095-510851aeb0fd" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-b996569d-c96d-4420-a095-510851aeb0fd" released by "delete_volume" :: held 0.863s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Created reservations ['e81875b0-9cdd-47c6-b01f-8221488e68b3', 'dc26e509-b044-47ed-83c3-ce891362fdf3', '4994b074-cb45-40fe-a7d8-afb26dcc2b70', '908661fb-6a1c-4422-afc5-b8cc6a9ce0ca'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:50 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:17:50 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:51 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.425s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:17:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Deleted volume successfully. Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-36d182a1-39ab-44b3-980e-50843b7a4a0e tempest-VolumesExtendTest-289656784 None] Lock "cinder-b996569d-c96d-4420-a095-510851aeb0fd-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Flow 'volume_create_manager' (8905670d-83b4-463d-b8e0-75dee63e8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d93bf8-bacd-4623-9cde-5b5fa23442ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d93bf8-bacd-4623-9cde-5b5fa23442ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-408886394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4c54e8-92e8-43b3-a428-dbd1cf40351e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7aa90c2569407aa2b8946a0d8aa681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:51Z,use_quota=True,user_id='e621770a7aa543af8c57cd0e9a589adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8042cb40-17fa-489c-9c6c-0f9856d8ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8042cb40-17fa-489c-9c6c-0f9856d8ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6b8c68-7df6-4a1c-af97-9fdd828fa34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6b8c68-7df6-4a1c-af97-9fdd828fa34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4c54e8-92e8-43b3-a428-dbd1cf40351e', 'volume_name': 'volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d31722-5402-456b-9109-cd1711d9ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d31722-5402-456b-9109-cd1711d9ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccbe758-e233-4fc7-9b33-c172320cd70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Volume 9d4c54e8-92e8-43b3-a428-dbd1cf40351e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e', 'volume_size': 1} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-408886394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4c54e8-92e8-43b3-a428-dbd1cf40351e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7aa90c2569407aa2b8946a0d8aa681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:17:51Z,use_quota=True,user_id='e621770a7aa543af8c57cd0e9a589adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Creating volume 9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:17:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:17:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:51 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e 1073741824 Sep 28 05:17:51 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:52 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e 1073741824" returned: 0 in 0.585s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:52 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:17:52 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:52 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccbe758-e233-4fc7-9b33-c172320cd70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a172a-dd3c-41fe-967e-e8b00ca0a293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:17:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Volume volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e (9d4c54e8-92e8-43b3-a428-dbd1cf40351e): created successfully Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a172a-dd3c-41fe-967e-e8b00ca0a293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:17:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Flow 'volume_create_manager' (8905670d-83b4-463d-b8e0-75dee63e8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:17:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7a50197d-1a25-4533-a1bb-a4dd70777e10 tempest-VolumesExtendTest-289656784 None] Created volume successfully. Sep 28 05:17:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Creating offline snapshot 84fdef56-352d-4309-a69e-41096de00285 of volume 9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:17:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8d921-8b70-4e6d-9836-d7715207311c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:53 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:17:53 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:54 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.378s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:54 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 1G Sep 28 05:17:54 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:54 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 1G" returned: 0 in 0.510s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:54 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 Sep 28 05:17:54 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:55 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285" returned: 0 in 0.332s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:55 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 is being set with open permissions: ugo+rw Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:55 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 Sep 28 05:17:55 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:55 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:55 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info Sep 28 05:17:55 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:55 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:55 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info is being set with open permissions: ugo+rw Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:55 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info Sep 28 05:17:55 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:55 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.info" returned: 0 in 0.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ea417b00-c68c-4ba0-8ab3-acaae1a8221d tempest-VolumesExtendTest-289656784 None] Create snapshot completed successfully Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34a0700-6f0b-4841-8035-24047bb6065c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:57 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:17:57 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:57 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.397s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 2G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 2G" returned: 0 in 0.191s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.637s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:17:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a855a8f7-b0fd-4ee9-b55d-bbef21a536cb tempest-VolumesExtendTest-289656784 None] Extend volume completed successfully. Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-84fdef56-352d-4309-a69e-41096de00285-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-84fdef56-352d-4309-a69e-41096de00285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-quobyte-84fdef56-352d-4309-a69e-41096de00285" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-84fdef56-352d-4309-a69e-41096de00285" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Deleting offline snapshot 84fdef56-352d-4309-a69e-41096de00285 of volume 9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] snapshot_file for this snap is: volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84331aab-3a35-4166-9fab-d95f8bac0320]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:58 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 Sep 28 05:17:58 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:58 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285" returned: 0 in 0.574s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:17:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4194bf-2cf2-47b4-bb7f-d7ecda4c1de4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:17:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:59 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:17:59 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:17:59 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 28 05:17:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.483s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:17:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:17:59 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 Sep 28 05:17:59 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:00 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285" returned: 0 in 0.707s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:00 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285 Sep 28 05:18:00 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e.84fdef56-352d-4309-a69e-41096de00285" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:00 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-84fdef56-352d-4309-a69e-41096de00285" released by "_delete_snapshot" :: held 2.352s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" released by "delete_snapshot" :: held 2.388s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Created reservations ['60a52d93-6579-4b0d-8fc1-d0c93f015653', '0de894c7-1f88-4b26-979f-a5f3ad8e3fdc', 'c6d7c18b-6c58-4c64-b1c3-2f6added630d', '1920d010-e42a-487f-b0f2-f2116bf97fee'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Delete snapshot completed successfully. Sep 28 05:18:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-445e839f-c239-49f3-976a-356163b6f560 tempest-VolumesExtendTest-289656784 None] Lock "cinder-84fdef56-352d-4309-a69e-41096de00285-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-9d4c54e8-92e8-43b3-a428-dbd1cf40351e-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "cinder-9d4c54e8-92e8-43b3-a428-dbd1cf40351e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Acquiring lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a58b7a2-7466-4831-8454-ee894f465918]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:01 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:18:01 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-ee30865f-4924-4937-9198-a421303c7568 req-e6fb2bc5-4cc0-453a-a6e8-6733d142f479 tempest-TestShelveInstance-1234515147 None] Terminate volume connection completed successfully. Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-ee30865f-4924-4937-9198-a421303c7568 req-e6fb2bc5-4cc0-453a-a6e8-6733d142f479 tempest-TestShelveInstance-1234515147 None] Deleting attachment 25d2fd59-8001-402c-9b0d-d2fa6d16464e. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Acquiring lock "cinder-af919f81-57b4-4a48-ad9f-5f339c5a9ed6-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:02 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.593s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "cinder-af919f81-57b4-4a48-ad9f-5f339c5a9ed6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:02 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e Sep 28 05:18:02 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Acquiring lock "cinder-quobyte-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "cinder-quobyte-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15cfa0-a177-4e0b-96da-66cdb363a370]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:02 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 Sep 28 05:18:02 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:02 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" returned: 0 in 0.483s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "cinder-quobyte-9d4c54e8-92e8-43b3-a428-dbd1cf40351e" released by "delete_volume" :: held 1.176s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Created reservations ['d3eaae5d-7f11-4c37-9597-d1850b6638ae', '7325e80e-7f1d-46fa-9ce4-54218a5b71bf', '9d80d20a-e1a2-403b-bc0b-ab5169f7db83', 'd3bfac66-530b-40d5-b12e-9637ca36c545'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:03 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:03 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:03 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" returned: 0 in 0.901s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:03 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6 Sep 28 05:18:03 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:03 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.454s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Deleted volume successfully. Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5208271b-7e7c-4eaf-898e-027a307a814f tempest-VolumesExtendTest-289656784 None] Lock "cinder-9d4c54e8-92e8-43b3-a428-dbd1cf40351e-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:03 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "cinder-quobyte-af919f81-57b4-4a48-ad9f-5f339c5a9ed6" released by "delete_volume" :: held 1.300s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.quota [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Created reservations ['026b17df-898d-442a-b313-01488251f6ab', '2599efc1-2e96-419d-a329-d91a1555c617', 'd6bdb19f-a888-4c62-ba02-aacfa4b45c68', 'e176cc5b-f274-407a-a5c4-e12382239641'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:03 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:03 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:04 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.302s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:04 devstack cinder-volume[86815]: DEBUG cinder.manager [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:04 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Deleted volume successfully. Sep 28 05:18:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [req-ee30865f-4924-4937-9198-a421303c7568 req-e76a3fcd-9ed9-4b55-9ee1-ba2055fe390a tempest-TestShelveInstance-1234515147 None] Lock "cinder-af919f81-57b4-4a48-ad9f-5f339c5a9ed6-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-16135ebe-93d4-453d-8771-8733492a700d req-2a627fb9-d7e1-4a6d-aea3-4ba6793ed17e tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-16135ebe-93d4-453d-8771-8733492a700d req-2a627fb9-d7e1-4a6d-aea3-4ba6793ed17e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-16135ebe-93d4-453d-8771-8733492a700d req-2a627fb9-d7e1-4a6d-aea3-4ba6793ed17e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-16135ebe-93d4-453d-8771-8733492a700d req-2a627fb9-d7e1-4a6d-aea3-4ba6793ed17e tempest-TestInstancesWithCinderVolumes-369834342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b449f5c-dcaf-4007-a127-f9b25a65e11f', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:18:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-16135ebe-93d4-453d-8771-8733492a700d req-2a627fb9-d7e1-4a6d-aea3-4ba6793ed17e tempest-TestInstancesWithCinderVolumes-369834342 None] attachment_update completed successfully. Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (59df1d2e-17d7-4fb3-a855-c9e42a8f23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5864ae8-da36-4687-adea-2c7f330b77c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5864ae8-da36-4687-adea-2c7f330b77c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143371225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f83df5-04bf-4b86-a8b4-286e523e191e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:10Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e8722-5516-4812-a20b-67719c9090d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e8722-5516-4812-a20b-67719c9090d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24586583-0fa6-4255-8922-05f7236ba59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24586583-0fa6-4255-8922-05f7236ba59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f83df5-04bf-4b86-a8b4-286e523e191e', 'volume_name': 'volume-66f83df5-04bf-4b86-a8b4-286e523e191e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f938cb4-0b1c-4eb3-a267-04cde79ec361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f938cb4-0b1c-4eb3-a267-04cde79ec361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233a6eb3-0670-42bc-b0f8-3365581806ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Volume 66f83df5-04bf-4b86-a8b4-286e523e191e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f83df5-04bf-4b86-a8b4-286e523e191e', 'volume_size': 1} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143371225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f83df5-04bf-4b86-a8b4-286e523e191e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:10Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Creating volume 66f83df5-04bf-4b86-a8b4-286e523e191e {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:10 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:10 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e 1073741824 Sep 28 05:18:10 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-a4263f10-0dbc-4e67-97b9-a5349669a9e2 req-0ec6cf5c-bd04-4a55-83ea-fd69dd247623 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:11 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e 1073741824" returned: 0 in 0.629s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:11 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e Sep 28 05:18:11 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Flow 'volume_create_manager' (ab126dc3-a6e2-4624-88b5-80700ab6a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8df45c-089f-49ff-a14d-145aaaa52e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8df45c-089f-49ff-a14d-145aaaa52e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1852628135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ef1a1b-97ec-4653-81b5-375b37eed2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6e130e348f44958a7b1fab52aec433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:11Z,use_quota=True,user_id='f605efa217174c4881b6eddbd42f8ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b14e804-3de7-4c08-b4e2-9a5c42805354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b14e804-3de7-4c08-b4e2-9a5c42805354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea9baed-49da-434a-8d7c-fe5034fb7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea9baed-49da-434a-8d7c-fe5034fb7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ef1a1b-97ec-4653-81b5-375b37eed2cf', 'volume_name': 'volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a6b93b-9d56-4301-a2c6-f3031f181829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a6b93b-9d56-4301-a2c6-f3031f181829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51e5580-cc0b-4495-891c-9f4d84334412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Volume 86ef1a1b-97ec-4653-81b5-375b37eed2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf', 'volume_size': 1} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:11 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-a4263f10-0dbc-4e67-97b9-a5349669a9e2 req-0ec6cf5c-bd04-4a55-83ea-fd69dd247623 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.785s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233a6eb3-0670-42bc-b0f8-3365581806ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f83df5-04bf-4b86-a8b4-286e523e191e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26b5074-24ef-418b-b1cb-f83a1f9af855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-a4263f10-0dbc-4e67-97b9-a5349669a9e2 req-0ec6cf5c-bd04-4a55-83ea-fd69dd247623 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1852628135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ef1a1b-97ec-4653-81b5-375b37eed2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6e130e348f44958a7b1fab52aec433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:11Z,use_quota=True,user_id='f605efa217174c4881b6eddbd42f8ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Creating volume 86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:11 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Volume volume-66f83df5-04bf-4b86-a8b4-286e523e191e (66f83df5-04bf-4b86-a8b4-286e523e191e): created successfully Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26b5074-24ef-418b-b1cb-f83a1f9af855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:11 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf 1073741824 Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (59df1d2e-17d7-4fb3-a855-c9e42a8f23c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:11 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-89c0e44d-53d5-4c1e-81cd-def3f0db5dcf tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:18:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-a4263f10-0dbc-4e67-97b9-a5349669a9e2 req-0ec6cf5c-bd04-4a55-83ea-fd69dd247623 tempest-TestInstancesWithCinderVolumes-369834342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-28d66a85-2f07-46bf-bba3-54b86c92969c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9ecfadb-5f11-46a0-b527-09a7127003e9', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:18:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-a4263f10-0dbc-4e67-97b9-a5349669a9e2 req-0ec6cf5c-bd04-4a55-83ea-fd69dd247623 tempest-TestInstancesWithCinderVolumes-369834342 None] attachment_update completed successfully. Sep 28 05:18:12 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf 1073741824" returned: 0 in 0.567s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:12 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:18:12 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:12 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.605s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51e5580-cc0b-4495-891c-9f4d84334412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19f6446-2f1f-46be-910b-33fd6ae57771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Volume volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf (86ef1a1b-97ec-4653-81b5-375b37eed2cf): created successfully Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19f6446-2f1f-46be-910b-33fd6ae57771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Flow 'volume_create_manager' (ab126dc3-a6e2-4624-88b5-80700ab6a044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0e97fb82-e159-40cd-8842-25e3befb00d5 tempest-TestStampPattern-643231710 None] Created volume successfully. Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (2db25206-864d-49f7-bf59-82fdfc8c0aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbacf91-02e2-4ecc-9634-f765e156d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbacf91-02e2-4ecc-9634-f765e156d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45734589',display_name='tempest-VolumesGetTest-Volume-427735149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea354aa5-0651-4e8a-9248-4ad87134fae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:14Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c621ed72-5e3c-4ce0-b4d2-ffd7db72118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c621ed72-5e3c-4ce0-b4d2-ffd7db72118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c530b1b-0102-44d0-8e2e-cf3ef97efbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c530b1b-0102-44d0-8e2e-cf3ef97efbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea354aa5-0651-4e8a-9248-4ad87134fae2', 'volume_name': 'volume-ea354aa5-0651-4e8a-9248-4ad87134fae2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9577f23-4fa3-4c00-9c74-53c7768f428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9577f23-4fa3-4c00-9c74-53c7768f428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f1cc90-8013-4c11-8f7d-4cda43be144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Volume ea354aa5-0651-4e8a-9248-4ad87134fae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea354aa5-0651-4e8a-9248-4ad87134fae2', 'volume_size': 1} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45734589',display_name='tempest-VolumesGetTest-Volume-427735149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea354aa5-0651-4e8a-9248-4ad87134fae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:14Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Creating volume ea354aa5-0651-4e8a-9248-4ad87134fae2 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:14 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 1073741824 Sep 28 05:18:14 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:14 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 1073741824" returned: 0 in 0.743s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:14 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 Sep 28 05:18:14 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:15 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f1cc90-8013-4c11-8f7d-4cda43be144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea354aa5-0651-4e8a-9248-4ad87134fae2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2429e64-8941-4873-8a8a-470173faaf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Volume volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 (ea354aa5-0651-4e8a-9248-4ad87134fae2): created successfully Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2429e64-8941-4873-8a8a-470173faaf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (2db25206-864d-49f7-bf59-82fdfc8c0aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-08c9d3a4-aac1-49e2-b785-201f8dd18deb tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-ea354aa5-0651-4e8a-9248-4ad87134fae2-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "cinder-ea354aa5-0651-4e8a-9248-4ad87134fae2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-ea354aa5-0651-4e8a-9248-4ad87134fae2" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-ea354aa5-0651-4e8a-9248-4ad87134fae2" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782511e-9ed8-4705-854c-5bb7996ba0be]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:16 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 Sep 28 05:18:16 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:16 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2" returned: 0 in 0.572s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:16 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2 Sep 28 05:18:16 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:17 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ea354aa5-0651-4e8a-9248-4ad87134fae2" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-ea354aa5-0651-4e8a-9248-4ad87134fae2" released by "delete_volume" :: held 0.985s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Created reservations ['81eedded-c8fa-46b5-9b0e-ab1c328b720d', 'e7bcec24-78ef-4be0-9b29-a3f107cdbe1a', 'a0ee53dd-25f3-4039-b9cf-9cd3aa297987', 'b0cedde2-845f-450b-a4e3-7de1ab6b110b'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:17 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:17 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:18 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.525s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-304ce6ee-46d4-479c-9bf3-c9c5896ba264 tempest-VolumesGetTest-621595968 None] Lock "cinder-ea354aa5-0651-4e8a-9248-4ad87134fae2-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-66f83df5-04bf-4b86-a8b4-286e523e191e-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "cinder-66f83df5-04bf-4b86-a8b4-286e523e191e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-66f83df5-04bf-4b86-a8b4-286e523e191e" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-66f83df5-04bf-4b86-a8b4-286e523e191e" acquired by "delete_volume" :: waited 0.045s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e9df2d-6178-4d0d-8fa2-89baf5bf0eff]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:19 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e Sep 28 05:18:19 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:19 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e" returned: 0 in 0.525s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:19 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e Sep 28 05:18:19 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-f22f6f76-ff7b-4e3a-a5e8-39e3bcb06466 req-7d9e08f9-00cb-4c71-8c6a-49006bb4d0d5 tempest-TestInstancesWithCinderVolumes-369834342 None] Terminate volume connection completed successfully. Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-f22f6f76-ff7b-4e3a-a5e8-39e3bcb06466 req-7d9e08f9-00cb-4c71-8c6a-49006bb4d0d5 tempest-TestInstancesWithCinderVolumes-369834342 None] Deleting attachment 2b449f5c-dcaf-4007-a127-f9b25a65e11f. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:18:19 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-66f83df5-04bf-4b86-a8b4-286e523e191e" returned: 0 in 0.411s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-66f83df5-04bf-4b86-a8b4-286e523e191e" released by "delete_volume" :: held 1.117s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Created reservations ['8ef9f85e-75a3-4e00-9ac1-cdaac5539b2c', '45dc43d8-3d96-40fe-a017-d38b3a63b18a', '9d684e78-7d0b-4007-928e-8668a021de33', '93a5d6a1-eec0-4eaf-8709-09ddd0ba7ad0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:20 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:20 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-quobyte-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1c864c-c020-48bf-9438-2840a52d4286]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:20 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:18:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-38d9a740-d647-49a0-b2ba-d31acc927383 tempest-VolumesGetTest-621595968 None] Lock "cinder-66f83df5-04bf-4b86-a8b4-286e523e191e-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:20 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 Sep 28 05:18:20 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:21 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" returned: 0 in 0.630s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:21 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1 Sep 28 05:18:21 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:21 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" returned: 0 in 0.655s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1" released by "delete_volume" :: held 1.377s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:21 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085039795-757464107 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085039795-757464107, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:21 devstack cinder-volume[86815]: WARNING cinder.quota [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085039795-757464107 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1085039795-757464107, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Created reservations ['05191785-345e-45d5-8b67-0e3614c37e25', 'ced44bd4-c503-4684-97ca-4ccc4d106939', '0bc02643-cdf1-4428-9f92-6fa2f62ec562', '25d302c6-90ca-42ce-9801-32fc8c4f2c50'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (9a1fe653-02c5-4ffc-bc8a-1a7543734aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229a019c-f9ef-4a58-b265-8f77eddfbb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:22 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229a019c-f9ef-4a58-b265-8f77eddfbb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772056597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185f78f7-a427-4c10-95ff-8a58a423d589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:22Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:22 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee67d0b-1310-40c5-af97-fba989fee741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee67d0b-1310-40c5-af97-fba989fee741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f7146d-6caf-4bcc-bc72-3ad833aa1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f7146d-6caf-4bcc-bc72-3ad833aa1b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185f78f7-a427-4c10-95ff-8a58a423d589', 'volume_name': 'volume-185f78f7-a427-4c10-95ff-8a58a423d589', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e7a76-f703-405c-b69d-08cea2473c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e7a76-f703-405c-b69d-08cea2473c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71747432-9192-45ae-93bc-38bc9ba214d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:22 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Volume 185f78f7-a427-4c10-95ff-8a58a423d589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185f78f7-a427-4c10-95ff-8a58a423d589', 'volume_size': 1} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-772056597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185f78f7-a427-4c10-95ff-8a58a423d589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:22Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Creating volume 185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:22 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:22 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 1073741824 Sep 28 05:18:22 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:22 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.441s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:22 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Deleted volume successfully. Sep 28 05:18:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4a29d5c7-e17b-4a22-a37d-545b2c781e2e tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-7b2b3655-d036-4b1b-8551-fe93ebd7e2c1-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:23 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 1073741824" returned: 0 in 0.766s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:23 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:23 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:23 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.442s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71747432-9192-45ae-93bc-38bc9ba214d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185f78f7-a427-4c10-95ff-8a58a423d589', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e5988d-77b0-42e7-bc4a-e1453a2f79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Volume volume-185f78f7-a427-4c10-95ff-8a58a423d589 (185f78f7-a427-4c10-95ff-8a58a423d589): created successfully Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e5988d-77b0-42e7-bc4a-e1453a2f79a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (9a1fe653-02c5-4ffc-bc8a-1a7543734aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3ef63d17-ea82-4afd-bbb1-7f4c560156d4 tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (2700ec98-218b-4b9d-8d25-842cfec419c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2347062-017f-407c-9514-fd49d1a5dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2347062-017f-407c-9514-fd49d1a5dab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-586228908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f97603-0c51-4d97-bfa1-2e526b96f4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:24Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad64efe-3a5e-4c0f-8cb0-756c232b7aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad64efe-3a5e-4c0f-8cb0-756c232b7aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63365dcf-b196-4ead-8b08-ff829ab69355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63365dcf-b196-4ead-8b08-ff829ab69355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f97603-0c51-4d97-bfa1-2e526b96f4c0', 'volume_name': 'volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33457748-a0cf-4672-afd6-b06f0b10a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33457748-a0cf-4672-afd6-b06f0b10a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387d935-3ed4-48f5-b543-b08f8fcc13f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Volume f0f97603-0c51-4d97-bfa1-2e526b96f4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0', 'volume_size': 1} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-586228908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f97603-0c51-4d97-bfa1-2e526b96f4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:24Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Creating volume f0f97603-0c51-4d97-bfa1-2e526b96f4c0 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:24 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:24 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 1073741824 Sep 28 05:18:24 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (33b365d1-f325-4860-83a0-d35d3145c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4726db-9ab2-4251-87dc-f3cd3ad55939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4726db-9ab2-4251-87dc-f3cd3ad55939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849306684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5462fc0-719c-4c17-969f-7fc0be6400cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:25Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f4d44-2cf0-4a35-ba9b-ead33e2f5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f4d44-2cf0-4a35-ba9b-ead33e2f5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b83717-be5c-4e12-9a55-e8200741666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b83717-be5c-4e12-9a55-e8200741666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5462fc0-719c-4c17-969f-7fc0be6400cd', 'volume_name': 'volume-a5462fc0-719c-4c17-969f-7fc0be6400cd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5987820d-ba73-4a8e-95d8-5c0b7be738c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5987820d-ba73-4a8e-95d8-5c0b7be738c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2faca9dc-b226-4203-8ef7-2370cb0be1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:25 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Volume a5462fc0-719c-4c17-969f-7fc0be6400cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5462fc0-719c-4c17-969f-7fc0be6400cd', 'volume_size': 1} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:25 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 1073741824" returned: 0 in 0.815s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:25 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 Sep 28 05:18:25 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (b6b8891a-9759-45ec-9b55-f2febcc00022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b445705-f5e9-4198-abb5-507b6cc58e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b445705-f5e9-4198-abb5-507b6cc58e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-961257935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=185f78f7-a427-4c10-95ff-8a58a423d589,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:26Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec89b4e3-2bc0-4a8a-90b2-7fc011ba6488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec89b4e3-2bc0-4a8a-90b2-7fc011ba6488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ac7e3c-e6d7-40cb-97bd-13dd4960f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (79490d63-e4d7-4b13-a2ae-0c94d0b32971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfc8081-888a-461f-963f-cc907b2476b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ac7e3c-e6d7-40cb-97bd-13dd4960f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef', 'volume_name': 'volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef', 'volume_size': 1, 'source_volid': '185f78f7-a427-4c10-95ff-8a58a423d589', 'source_volstatus': 'available'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ba6bab-ead6-4662-868a-15d47879ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ba6bab-ead6-4662-868a-15d47879ce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a48505-10f1-470a-b428-b3516babd0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Volume 3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef', 'volume_size': 1, 'source_volid': '185f78f7-a427-4c10-95ff-8a58a423d589', 'source_volstatus': 'available'} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfc8081-888a-461f-963f-cc907b2476b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202668801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0669aa7-079f-4bf6-8454-39f6af80fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:26Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1df5b-e97a-476d-b892-f8290b7d7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1df5b-e97a-476d-b892-f8290b7d7b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b94fc9-f9f8-4ce9-9528-ddedc74830cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b94fc9-f9f8-4ce9-9528-ddedc74830cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0669aa7-079f-4bf6-8454-39f6af80fe17', 'volume_name': 'volume-c0669aa7-079f-4bf6-8454-39f6af80fe17', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677610e3-2ce0-4a7a-bc05-a148092e6052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677610e3-2ce0-4a7a-bc05-a148092e6052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcda6a5-fec3-4b83-8521-a8da6aa43b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Volume c0669aa7-079f-4bf6-8454-39f6af80fe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0669aa7-079f-4bf6-8454-39f6af80fe17', 'volume_size': 1} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:26 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" returned: 0 in 0.741s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849306684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5462fc0-719c-4c17-969f-7fc0be6400cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:25Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Creating volume a5462fc0-719c-4c17-969f-7fc0be6400cd {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:26 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:26 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd 1073741824 Sep 28 05:18:26 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387d935-3ed4-48f5-b543-b08f8fcc13f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ec3f27-dba9-4253-a059-0edc62bae8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (6fd3f627-5555-491d-9c84-c95c85c2c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ff1956-92ef-4cca-a5e9-b02db9dadd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Volume volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 (f0f97603-0c51-4d97-bfa1-2e526b96f4c0): created successfully Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ec3f27-dba9-4253-a059-0edc62bae8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (2700ec98-218b-4b9d-8d25-842cfec419c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ff1956-92ef-4cca-a5e9-b02db9dadd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-261452965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c83d4-371c-45eb-92dc-366921c452f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:27Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e34a2b-10e2-4175-96bf-2cab26b174a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e34a2b-10e2-4175-96bf-2cab26b174a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353d301a-0675-4fc9-9c84-1fe2eaa9e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353d301a-0675-4fc9-9c84-1fe2eaa9e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90c83d4-371c-45eb-92dc-366921c452f4', 'volume_name': 'volume-e90c83d4-371c-45eb-92dc-366921c452f4', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b3fac-9994-4e85-9359-cef7dd27c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b3fac-9994-4e85-9359-cef7dd27c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e546e25d-dfd5-459f-a21c-4d405ed7f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Volume e90c83d4-371c-45eb-92dc-366921c452f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90c83d4-371c-45eb-92dc-366921c452f4', 'volume_size': 1} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f7d56f8d-bc90-45b6-9d34-d2866eed5edd tempest-CreateVolumesFromImageTest-1692133119 None] Created volume successfully. Sep 28 05:18:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-80a64c29-74a3-4481-9534-24542b67571b req-70b9234f-cf1b-4876-abb6-dd16f87668eb tempest-TestInstancesWithCinderVolumes-369834342 None] Terminate volume connection completed successfully. Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-80a64c29-74a3-4481-9534-24542b67571b req-70b9234f-cf1b-4876-abb6-dd16f87668eb tempest-TestInstancesWithCinderVolumes-369834342 None] Deleting attachment c9ecfadb-5f11-46a0-b527-09a7127003e9. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (056a5321-b3a3-4a4c-a49d-bcb3bb9a7e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedd699b-0b8a-4e16-975f-96ad5d48c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedd699b-0b8a-4e16-975f-96ad5d48c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823667268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc43a34-cf73-4c94-a286-0cbec3a2e8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:27Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfeb31eb-c896-4908-a2d2-c0ed9fc9a2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfeb31eb-c896-4908-a2d2-c0ed9fc9a2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f600eb7f-ac28-4650-8776-8289018d3292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f600eb7f-ac28-4650-8776-8289018d3292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc43a34-cf73-4c94-a286-0cbec3a2e8ed', 'volume_name': 'volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6d6a13-ff6e-4403-82d2-9edade0764b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6d6a13-ff6e-4403-82d2-9edade0764b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842040b4-45a7-4d75-9068-9304ffc62797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Volume 8dc43a34-cf73-4c94-a286-0cbec3a2e8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed', 'volume_size': 1} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd 1073741824" returned: 0 in 1.021s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:27 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd Sep 28 05:18:27 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:27 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-202668801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0669aa7-079f-4bf6-8454-39f6af80fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:26Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Creating volume c0669aa7-079f-4bf6-8454-39f6af80fe17 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:27 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2faca9dc-b226-4203-8ef7-2370cb0be1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5462fc0-719c-4c17-969f-7fc0be6400cd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea44a88-9e5c-4b72-bcec-0cd21c089ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:28 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 1073741824 Sep 28 05:18:28 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:28 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Volume volume-a5462fc0-719c-4c17-969f-7fc0be6400cd (a5462fc0-719c-4c17-969f-7fc0be6400cd): created successfully Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea44a88-9e5c-4b72-bcec-0cd21c089ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (33b365d1-f325-4860-83a0-d35d3145c425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-82220fbd-291c-47f1-8ec4-c1f3ec915c12 tempest-CreateVolumesFromImageTest-1692133119 None] Created volume successfully. Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-28d66a85-2f07-46bf-bba3-54b86c92969c-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-28d66a85-2f07-46bf-bba3-54b86c92969c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-quobyte-28d66a85-2f07-46bf-bba3-54b86c92969c" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-28d66a85-2f07-46bf-bba3-54b86c92969c" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b16ee94-dad0-436d-acb2-cf60d9399d59]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:28 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 1073741824" returned: 0 in 0.731s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:28 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c Sep 28 05:18:28 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:28 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 Sep 28 05:18:28 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:29 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c" returned: 0 in 0.681s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:29 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17" returned: 0 in 0.449s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.900s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:29 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Cloning volume 185f78f7-a427-4c10-95ff-8a58a423d589 to volume 3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef Sep 28 05:18:29 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c Sep 28 05:18:29 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcda6a5-fec3-4b83-8521-a8da6aa43b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0669aa7-079f-4bf6-8454-39f6af80fe17', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595846ca-5a20-4b2d-84a8-a21a6ab55856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:29 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Volume volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 (c0669aa7-079f-4bf6-8454-39f6af80fe17): created successfully Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595846ca-5a20-4b2d-84a8-a21a6ab55856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (79490d63-e4d7-4b13-a2ae-0c94d0b32971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9dbb0bcf-5279-4813-b856-d49345a620d4 tempest-CreateVolumesFromImageTest-1692133119 None] Created volume successfully. Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Creating offline snapshot 89ed0b52-22c4-4475-a3ee-916b9e6400df of volume 185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a6430-95f5-4a3b-93cc-6c51195768c0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:29 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:29 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:29 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-28d66a85-2f07-46bf-bba3-54b86c92969c" returned: 0 in 0.396s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-28d66a85-2f07-46bf-bba3-54b86c92969c" released by "delete_volume" :: held 1.149s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:29 devstack cinder-volume[86815]: WARNING cinder.quota [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-991086477-1512344253 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-991086477-1512344253, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:29 devstack cinder-volume[86815]: WARNING cinder.quota [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-991086477-1512344253 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-991086477-1512344253, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:29 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:29 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:29 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Created reservations ['5127869e-cf73-4f6c-b7ba-cb1400a474ae', 'b70843d5-f09c-4083-a6d8-cb0f7d267b39', '3a756a3f-2573-43b0-ad86-a264628e019f', '6c59fc10-01c6-4b70-a968-0379b0e212af'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:29 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:29 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:30 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.807s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:30 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df 1G Sep 28 05:18:30 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:30 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.414s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Deleted volume successfully. Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eaa925ac-338c-4064-8908-cf9d4363f9cc tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-28d66a85-2f07-46bf-bba3-54b86c92969c-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:30 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df 1G" returned: 0 in 0.551s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185f78f7-a427-4c10-95ff-8a58a423d589 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:30 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185f78f7-a427-4c10-95ff-8a58a423d589 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:30 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:31 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185f78f7-a427-4c10-95ff-8a58a423d589 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.510s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:31 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df is being set with open permissions: ugo+rw Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:31 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:31 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:31 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.294s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:31 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info Sep 28 05:18:31 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:31 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:31 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info is being set with open permissions: ugo+rw Sep 28 05:18:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:32 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info Sep 28 05:18:32 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:32 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.info" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] snapshot: 89ed0b52-22c4-4475-a3ee-916b9e6400df, volume: 3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67829b97-6b21-4344-bedd-3f8f0f43dd70]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:32 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:32 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:33 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.698s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185f78f7-a427-4c10-95ff-8a58a423d589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29c0bfc-3213-4166-ba70-0e44e91da4fe]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:33 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:33 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:33 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.696s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:18:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:33 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef Sep 28 05:18:33 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-58d3c7a7-2b30-4650-a2f3-a203b6f1fcd6 req-c850ed24-fd8e-45e2-837c-d85084d1f7ef tempest-TestInstancesWithCinderVolumes-369834342 None] Terminate volume connection completed successfully. Sep 28 05:18:34 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-58d3c7a7-2b30-4650-a2f3-a203b6f1fcd6 req-c850ed24-fd8e-45e2-837c-d85084d1f7ef tempest-TestInstancesWithCinderVolumes-369834342 None] Deleting attachment fcf0ae15-bee4-47e2-a705-94145d7338b4. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=105,cinder:UPDATE=107,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=97,cinder:SELECT=87,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "cinder-quobyte-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65adc09b-314b-4caf-bb52-e1af20658dee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:36 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 Sep 28 05:18:36 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:37 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" returned: 0 in 0.593s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:37 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0 Sep 28 05:18:37 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:37 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" returned: 0 in 0.493s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-quobyte-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0" released by "delete_volume" :: held 1.168s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:37 devstack cinder-volume[86815]: WARNING cinder.quota [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768334707-985292269 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768334707-985292269, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:37 devstack cinder-volume[86815]: WARNING cinder.quota [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768334707-985292269 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768334707-985292269, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Created reservations ['ddeabd8e-fae8-4c88-ad48-694b583d39aa', '9060a0fb-159f-42a4-a7a8-dbad6e583fa0', 'b0365d7b-7cab-48d0-a2bf-e2d9b0912a58', '480663e9-383d-4c34-ad7f-5e5a6992ad64'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:37 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:37 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:38 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.342s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:38 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Deleted volume successfully. Sep 28 05:18:38 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-161f7f82-5cff-4081-a6d0-3103d44be137 tempest-TestInstancesWithCinderVolumes-369834342 None] Lock "cinder-86eb28f9-3943-40e8-ab94-0bda5bc7f7d0-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:41 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" returned: 0 in 7.301s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:18:41 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Converted 1024.00 MB image at 140.24 MB/s Sep 28 05:18:41 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef is being set with open permissions: ugo+rw Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:41 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef Sep 28 05:18:41 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:41 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" returned: 0 in 0.257s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" released by "_copy_volume_from_snapshot" :: held 9.059s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-89ed0b52-22c4-4475-a3ee-916b9e6400df" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-89ed0b52-22c4-4475-a3ee-916b9e6400df" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Deleting offline snapshot 89ed0b52-22c4-4475-a3ee-916b9e6400df of volume 185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] snapshot_file for this snap is: volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fd899-f89b-4111-9380-bfd14b1f5a4a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:41 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:41 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:41 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185f78f7-a427-4c10-95ff-8a58a423d589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1bb43-8a36-40bd-b142-41a18ecd5f15]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:42 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:42 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:42 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.576s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:42 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:42 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:42 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:42 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df Sep 28 05:18:42 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:43 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589.89ed0b52-22c4-4475-a3ee-916b9e6400df" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-89ed0b52-22c4-4475-a3ee-916b9e6400df" released by "_delete_snapshot" :: held 1.815s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.107s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.364s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-261452965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c83d4-371c-45eb-92dc-366921c452f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:27Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Creating volume e90c83d4-371c-45eb-92dc-366921c452f4 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:43 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a48505-10f1-470a-b428-b3516babd0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef', 'volume_size': 1, 'source_volid': '185f78f7-a427-4c10-95ff-8a58a423d589', 'source_volstatus': 'available'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:43 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 1073741824 Sep 28 05:18:43 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7bc57b-f086-4971-9f91-8699fc813e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:43 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Volume volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef (3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef): created successfully Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7bc57b-f086-4971-9f91-8699fc813e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (b6b8891a-9759-45ec-9b55-f2febcc00022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cbd386c3-443d-43cb-9caa-566382f4ee2e tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:18:43 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 1073741824" returned: 0 in 0.469s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:43 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 Sep 28 05:18:43 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:44 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4" returned: 0 in 0.341s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.664s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823667268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc43a34-cf73-4c94-a286-0cbec3a2e8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41477aa4b9a45ea9d1eba5c27bb5297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:27Z,use_quota=True,user_id='4e34583c867344ae909e0503e3007910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Creating volume 8dc43a34-cf73-4c94-a286-0cbec3a2e8ed {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:44 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e546e25d-dfd5-459f-a21c-4d405ed7f663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90c83d4-371c-45eb-92dc-366921c452f4', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55520c7a-df57-46b3-9934-6ddb2544d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:44 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed 1073741824 Sep 28 05:18:44 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Volume volume-e90c83d4-371c-45eb-92dc-366921c452f4 (e90c83d4-371c-45eb-92dc-366921c452f4): created successfully Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55520c7a-df57-46b3-9934-6ddb2544d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (6fd3f627-5555-491d-9c84-c95c85c2c738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-508b5e90-9b5e-4fa3-8314-825c18ac4597 tempest-CreateVolumesFromImageTest-1692133119 None] Created volume successfully. Sep 28 05:18:44 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed 1073741824" returned: 0 in 0.525s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:44 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed Sep 28 05:18:44 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:45 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" returned: 0 in 0.315s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842040b4-45a7-4d75-9068-9304ffc62797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def41cb8-a6dc-41a2-896e-cb3a80265600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (01e1c6b2-8b69-4b37-bdbb-af15d128af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9379d368-b6cb-4b6b-824d-602f626bf564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Volume volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed (8dc43a34-cf73-4c94-a286-0cbec3a2e8ed): created successfully Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def41cb8-a6dc-41a2-896e-cb3a80265600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Flow 'volume_create_manager' (056a5321-b3a3-4a4c-a49d-bcb3bb9a7e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9379d368-b6cb-4b6b-824d-602f626bf564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1687976664',display_name='tempest-VolumesGetTest-Volume-1440903661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eac5cd-3138-47fc-84a2-4776a836e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:45Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58740df-5dd0-49a2-89d7-46ff7802cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58740df-5dd0-49a2-89d7-46ff7802cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e51c69-52e7-45cb-952b-056f6a9e822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e51c69-52e7-45cb-952b-056f6a9e822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5eac5cd-3138-47fc-84a2-4776a836e614', 'volume_name': 'volume-b5eac5cd-3138-47fc-84a2-4776a836e614', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c72633-56bc-4d3c-8dcf-688b28439c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c72633-56bc-4d3c-8dcf-688b28439c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4a49ac-d7cb-4190-b3f0-7f73825d6296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Volume b5eac5cd-3138-47fc-84a2-4776a836e614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5eac5cd-3138-47fc-84a2-4776a836e614', 'volume_size': 1} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1687976664',display_name='tempest-VolumesGetTest-Volume-1440903661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eac5cd-3138-47fc-84a2-4776a836e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:45Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Creating volume b5eac5cd-3138-47fc-84a2-4776a836e614 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:45 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e3e44e78-fa44-469a-8c7d-a87a700756ee tempest-CreateVolumesFromImageTest-1692133119 None] Created volume successfully. Sep 28 05:18:45 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 1073741824 Sep 28 05:18:45 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-quobyte-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c78679-d3d2-46bb-9df8-60264303bf9c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:45 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed Sep 28 05:18:45 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:45 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 1073741824" returned: 0 in 0.556s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:45 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" returned: 0 in 0.425s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:45 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 Sep 28 05:18:45 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:45 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed Sep 28 05:18:45 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:46 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4a49ac-d7cb-4190-b3f0-7f73825d6296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5eac5cd-3138-47fc-84a2-4776a836e614', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:46 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefd1296-a106-42f6-8607-4dd819552683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:46 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Volume volume-b5eac5cd-3138-47fc-84a2-4776a836e614 (b5eac5cd-3138-47fc-84a2-4776a836e614): created successfully Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefd1296-a106-42f6-8607-4dd819552683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (01e1c6b2-8b69-4b37-bdbb-af15d128af42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed" released by "delete_volume" :: held 0.787s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dbf638e7-7137-4de4-bfd6-b42408d4c03b tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Created reservations ['efd3b9da-228f-4d6c-9bd5-36ae9a2b9a48', '1fd5eff7-56d9-4b36-a91f-bd8d50696116', '612809c1-dc74-4ed3-921c-e06c264c5ccf', 'cb922fa3-5f49-452d-b337-1afbd387acc3'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:46 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:46 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-e90c83d4-371c-45eb-92dc-366921c452f4-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-e90c83d4-371c-45eb-92dc-366921c452f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:46 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.274s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Deleted volume successfully. Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-quobyte-e90c83d4-371c-45eb-92dc-366921c452f4" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55cb9b54-4b3e-4944-921d-a247e1f71ddc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-8dc43a34-cf73-4c94-a286-0cbec3a2e8ed-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-e90c83d4-371c-45eb-92dc-366921c452f4" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c51cef8-26a0-4b2c-bdfa-e3df6c6ae41b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:46 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 Sep 28 05:18:46 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:47 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4" returned: 0 in 0.373s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:47 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4 Sep 28 05:18:47 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-b5eac5cd-3138-47fc-84a2-4776a836e614-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "cinder-b5eac5cd-3138-47fc-84a2-4776a836e614-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:47 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-b5eac5cd-3138-47fc-84a2-4776a836e614" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e90c83d4-371c-45eb-92dc-366921c452f4" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-e90c83d4-371c-45eb-92dc-366921c452f4" released by "delete_volume" :: held 0.729s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-b5eac5cd-3138-47fc-84a2-4776a836e614" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b342887-eb45-499a-94d4-a4fae3e0f1f6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Created reservations ['26b1a4bc-4b51-4757-9bee-c1d24f589f23', '86f0b11b-7a54-4fee-9fc5-40fb74f39288', '96e0f37d-0bd2-4f5b-9ec3-c91957da5f8a', '48420862-3d60-46f8-bc59-3ad5a8cc20b3'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:47 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 Sep 28 05:18:47 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:47 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:47 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-c0669aa7-079f-4bf6-8454-39f6af80fe17-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-c0669aa7-079f-4bf6-8454-39f6af80fe17-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-quobyte-c0669aa7-079f-4bf6-8454-39f6af80fe17" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-c0669aa7-079f-4bf6-8454-39f6af80fe17" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc78b02f-8237-45f7-8e91-61c5cf67e091]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:48 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614" returned: 0 in 0.566s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:48 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614 Sep 28 05:18:48 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:48 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 Sep 28 05:18:48 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.484s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Deleted volume successfully. Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6288f424-c038-42d5-9cd7-32b4324495f0 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-e90c83d4-371c-45eb-92dc-366921c452f4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:48 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5eac5cd-3138-47fc-84a2-4776a836e614" returned: 0 in 0.315s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-b5eac5cd-3138-47fc-84a2-4776a836e614" released by "delete_volume" :: held 0.943s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:48 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Created reservations ['2795a31b-affa-4ccf-8bbe-3ca49ad3a37d', '471ae84d-e039-476a-820e-efe9fc667926', 'a21315d3-740d-42b7-afd5-ed07d559580a', 'b5ed19fa-0cdd-4f90-b994-61c335de5659'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:48 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17 Sep 28 05:18:48 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:48 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:48 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:48 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-c0669aa7-079f-4bf6-8454-39f6af80fe17" returned: 0 in 0.314s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-c0669aa7-079f-4bf6-8454-39f6af80fe17" released by "delete_volume" :: held 0.850s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Created reservations ['d29ed544-a9a5-47f2-b3c3-f596a387a075', '8de0668b-5785-44cc-873d-24e83cb3e6c6', '5369f105-dbc7-45fa-a71c-bd803e912bc5', '8a8bf227-a1cd-4c26-bfb3-648e46648490'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:48 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.335s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9327d493-2470-46b7-ade3-96a2ccb1d623 tempest-VolumesGetTest-621595968 None] Lock "cinder-b5eac5cd-3138-47fc-84a2-4776a836e614-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:49 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:49 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-a5462fc0-719c-4c17-969f-7fc0be6400cd-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-a5462fc0-719c-4c17-969f-7fc0be6400cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-quobyte-a5462fc0-719c-4c17-969f-7fc0be6400cd" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:49 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-a5462fc0-719c-4c17-969f-7fc0be6400cd" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-83426748-c114-4100-a52f-b170f3c12a60 req-8c723868-b2a2-45e3-b2bd-e71d1515314e tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-83426748-c114-4100-a52f-b170f3c12a60 req-8c723868-b2a2-45e3-b2bd-e71d1515314e tempest-TestStampPattern-643231710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.363s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Deleted volume successfully. Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-83426748-c114-4100-a52f-b170f3c12a60 req-8c723868-b2a2-45e3-b2bd-e71d1515314e tempest-TestStampPattern-643231710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae66bd9-ce35-4f81-bbbd-88d7205c8db4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-da548265-64d1-4e31-9861-3c6d3f704a44 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-c0669aa7-079f-4bf6-8454-39f6af80fe17-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-83426748-c114-4100-a52f-b170f3c12a60 req-8c723868-b2a2-45e3-b2bd-e71d1515314e tempest-TestStampPattern-643231710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b846b72-acdc-45a8-8a33-63fae6e22e1c', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:18:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-83426748-c114-4100-a52f-b170f3c12a60 req-8c723868-b2a2-45e3-b2bd-e71d1515314e tempest-TestStampPattern-643231710 None] attachment_update completed successfully. Sep 28 05:18:49 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd Sep 28 05:18:49 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "cinder-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:49 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd" returned: 0 in 0.596s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2950fd-7ac5-434a-b201-edd02e0e3b44]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:49 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd Sep 28 05:18:49 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:50 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef Sep 28 05:18:50 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:50 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a5462fc0-719c-4c17-969f-7fc0be6400cd" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-a5462fc0-719c-4c17-969f-7fc0be6400cd" released by "delete_volume" :: held 1.123s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Created reservations ['50ce09b3-1c65-4233-a961-9152a8d21e74', '8c8ec594-d562-430c-992d-9216f03b646b', '32fc2294-ed4b-4aca-83ad-f46610aabcf1', '89c387f3-70ce-4cd8-a265-1b86dd20224c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:50 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" returned: 0 in 0.579s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:50 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef Sep 28 05:18:50 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:50 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:50 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:51 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.369s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Deleted volume successfully. Sep 28 05:18:51 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" returned: 0 in 0.561s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cb6d726b-c460-4eb7-a465-bcf909c468cc tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-a5462fc0-719c-4c17-969f-7fc0be6400cd-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef" released by "delete_volume" :: held 1.216s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Created reservations ['45d9a6cd-c57f-4c76-a5bd-17c976144fee', '9eb090c8-4c82-400f-9ae5-766fe6e5d13f', 'd8f60149-a49e-4889-96af-d696f01205d1', '6d154ffb-79a4-4578-b4bf-2c26bcf2e93f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:51 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:51 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-f0f97603-0c51-4d97-bfa1-2e526b96f4c0-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-f0f97603-0c51-4d97-bfa1-2e526b96f4c0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "cinder-quobyte-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:51 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.416s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6950b6-8b41-4c91-bf64-85427f17f8df]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-80602841-399a-46ed-b52f-4bf161e43118 tempest-VolumesGetTest-621595968 None] Lock "cinder-3f0908cc-3bc9-4010-a3dd-5e9d6c3256ef-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:51 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 Sep 28 05:18:51 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:52 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" returned: 0 in 0.446s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:52 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0 Sep 28 05:18:52 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-185f78f7-a427-4c10-95ff-8a58a423d589-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "cinder-185f78f7-a427-4c10-95ff-8a58a423d589-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-185f78f7-a427-4c10-95ff-8a58a423d589" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-185f78f7-a427-4c10-95ff-8a58a423d589" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b0b7c-0620-45b1-a0dd-f5c5508d8158]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:52 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" returned: 0 in 0.361s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-quobyte-f0f97603-0c51-4d97-bfa1-2e526b96f4c0" released by "delete_volume" :: held 0.873s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:52 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:52 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Created reservations ['4758eb4f-9e2c-409b-aeaf-3ccf2130fd08', 'eaba1056-822b-4a2d-8e8b-8cdc21b4fc17', '6eb8f804-0811-45bb-b2cc-d862627217e1', 'ad2c9380-7388-4f82-be02-653bedf14ad9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:52 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:52 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:52 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.534s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:53 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589 Sep 28 05:18:53 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:53 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.285s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:53 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Deleted volume successfully. Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-477f9aa5-f8ef-47b6-847c-987d2689f0c5 tempest-CreateVolumesFromImageTest-1692133119 None] Lock "cinder-f0f97603-0c51-4d97-bfa1-2e526b96f4c0-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:53 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-185f78f7-a427-4c10-95ff-8a58a423d589" returned: 0 in 0.296s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-185f78f7-a427-4c10-95ff-8a58a423d589" released by "delete_volume" :: held 0.913s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Created reservations ['8729bc0b-9d77-41b0-9c1f-c4e55a605020', '3e70953c-8dcf-48ec-8bb8-cdbe83d1733e', '65345f81-03b1-4b57-9576-c0fc969bb1a1', '28f368f0-93a1-4d5c-a59d-91b06605d558'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:53 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:18:53 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:53 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.306s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:18:53 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:18:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d36b4fc5-462d-40cd-a860-f60d5f348513 tempest-VolumesGetTest-621595968 None] Lock "cinder-185f78f7-a427-4c10-95ff-8a58a423d589-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (0c1047f7-a874-4eb4-97b0-a733eb43df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783817d-92db-4bec-9fc8-4855267d936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783817d-92db-4bec-9fc8-4855267d936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1445271439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ebf331-5988-4f6e-ac6e-89bf8723926a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:54Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb1663-af68-4457-b955-2435c4a3393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb1663-af68-4457-b955-2435c4a3393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13781d87-1993-4f84-816c-ac1de24bfecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:54 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13781d87-1993-4f84-816c-ac1de24bfecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17ebf331-5988-4f6e-ac6e-89bf8723926a', 'volume_name': 'volume-17ebf331-5988-4f6e-ac6e-89bf8723926a', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0696b1c1-057f-4dec-a108-74777b8f1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0696b1c1-057f-4dec-a108-74777b8f1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb86df-a611-41e6-b7f2-58662657dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Volume 17ebf331-5988-4f6e-ac6e-89bf8723926a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17ebf331-5988-4f6e-ac6e-89bf8723926a', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Trying to clone 17ebf331-5988-4f6e-ac6e-89bf8723926a from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (71edbdbc-745c-4158-bf55-b5f6e512cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f205c793-66f6-490f-be3c-6395153f21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f205c793-66f6-490f-be3c-6395153f21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088616072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ce854-7121-496a-8894-ad127e4f39b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:55Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11c9bb-b857-4dda-9984-7ee72a5a91c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11c9bb-b857-4dda-9984-7ee72a5a91c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38f8b05-b1e8-4936-942b-cc96494e3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38f8b05-b1e8-4936-942b-cc96494e3216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0ce854-7121-496a-8894-ad127e4f39b5', 'volume_name': 'volume-ef0ce854-7121-496a-8894-ad127e4f39b5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa47f68-4910-48c9-855d-000636fe9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa47f68-4910-48c9-855d-000636fe9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581fff39-19e4-4cc6-99d3-f85339f25a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume ef0ce854-7121-496a-8894-ad127e4f39b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0ce854-7121-496a-8894-ad127e4f39b5', 'volume_size': 1} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088616072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ce854-7121-496a-8894-ad127e4f39b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:55Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:55 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:55 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 1073741824 Sep 28 05:18:55 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:18:55 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Image download 20.69 MB at 20.69 MB/s Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd959a96-5359-4250-94ee-545b15561597]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:55 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD Sep 28 05:18:55 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-7779f512-b0ef-4d24-bae3-935d79afb8eb req-a7b2f98e-b416-40e4-8607-d88ee8969c13 tempest-TestStampPattern-643231710 None] Terminate volume connection completed successfully. Sep 28 05:18:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-7779f512-b0ef-4d24-bae3-935d79afb8eb req-a7b2f98e-b416-40e4-8607-d88ee8969c13 tempest-TestStampPattern-643231710 None] Deleting attachment 2b846b72-acdc-45a8-8a33-63fae6e22e1c. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:18:56 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 1073741824" returned: 0 in 0.664s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:56 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 Sep 28 05:18:56 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:56 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b is fetched for user aaf421dbd82a459083c5cbdf6872a0b9. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6791f04-a826-4b3a-a1bf-e2cdd68fcddf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:56 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD Sep 28 05:18:56 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:56 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5" returned: 0 in 0.370s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581fff39-19e4-4cc6-99d3-f85339f25a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0ce854-7121-496a-8894-ad127e4f39b5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c8d39c-322f-4624-8e08-0df65afb33e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-ef0ce854-7121-496a-8894-ad127e4f39b5 (ef0ce854-7121-496a-8894-ad127e4f39b5): created successfully Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c8d39c-322f-4624-8e08-0df65afb33e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (71edbdbc-745c-4158-bf55-b5f6e512cb56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bc72dcc0-1904-4900-8513-b6dcad13fd5e tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Creating offline snapshot 90b19385-08c6-40b5-9bc8-d8ee1524c12a of volume 86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[277b09d5-1b14-4f8f-8c59-1b6ca92bf368]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:56 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:56 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:18:56 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:57 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.377s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:57 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a 1G Sep 28 05:18:57 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:57 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a 1G" returned: 0 in 0.502s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:57 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:18:57 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:57 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.323s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:57 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a is being set with open permissions: ugo+rw Sep 28 05:18:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:57 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:18:57 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:58 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:58 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info Sep 28 05:18:58 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Flow 'volume_create_manager' (d54c2c93-7c8a-44a6-9b91-bb119248221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e65d1f-f7ad-49ee-8887-b73bae441f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e65d1f-f7ad-49ee-8887-b73bae441f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496276390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968261b2-ec7c-400c-9c3c-b859e5fa6e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55ca1e6c24b41feac119f027a3701b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:58Z,use_quota=True,user_id='300f188f61f6414799bb7f51cb36b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc36786d-42b9-4389-83e2-e784f3d5afe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc36786d-42b9-4389-83e2-e784f3d5afe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1ef828-7265-4c99-a5f8-a379ffe7a95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:58 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1ef828-7265-4c99-a5f8-a379ffe7a95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968261b2-ec7c-400c-9c3c-b859e5fa6e97', 'volume_name': 'volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4198d-33e4-41a8-bb96-edc0f9076864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4198d-33e4-41a8-bb96-edc0f9076864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11670d7c-e754-4e10-b4e0-d98d0a311282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:18:58 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Volume 968261b2-ec7c-400c-9c3c-b859e5fa6e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97', 'volume_size': 1} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info" returned: 0 in 0.303s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:58 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info is being set with open permissions: ugo+rw Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:58 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info Sep 28 05:18:58 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:58 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.info" returned: 0 in 0.261s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1445271439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ebf331-5988-4f6e-ac6e-89bf8723926a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:54Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Creating volume 17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:18:58 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:18:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:58 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1073741824 Sep 28 05:18:58 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-981ef000-f3a5-4b06-9566-bf21bb5d1220 tempest-TestStampPattern-643231710 None] Create snapshot completed successfully Sep 28 05:18:59 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1073741824" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:59 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a Sep 28 05:18:59 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:59 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.953s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating offline snapshot a5474d3b-4b76-4608-9537-0c9f4ee3cd2a of volume ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Attempting download of 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume 17ebf331-5988-4f6e-ac6e-89bf8723926a. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970b3ae-31ff-4123-8793-cfc4dc00690e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c923262-12b6-4825-af21-7703e2ce5df2]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:59 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 Sep 28 05:18:59 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:59 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec Sep 28 05:18:59 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:18:59 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5" returned: 0 in 0.402s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:59 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec" returned: 0 in 0.374s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:18:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:18:59 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a 1G Sep 28 05:18:59 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec Sep 28 05:19:00 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec" returned: 1 in 0.370s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cf8d7db-9851-461c-94d0-a979c9e2e98b_7gtqurec' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49bda90-2996-4fe5-90a6-73e4f2afed0c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:00 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a 1G" returned: 0 in 0.457s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0ce854-7121-496a-8894-ad127e4f39b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:00 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0ce854-7121-496a-8894-ad127e4f39b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a Sep 28 05:19:00 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD Sep 28 05:19:00 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] 1cf8d7db-9851-461c-94d0-a979c9e2e98b was qcow2, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:00 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0ce854-7121-496a-8894-ad127e4f39b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:00 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a is being set with open permissions: ugo+rw Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:00 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a Sep 28 05:19:00 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a Sep 28 05:19:00 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:00 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" returned: 0 in 0.276s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:01 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info Sep 28 05:19:01 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:01 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info" returned: 0 in 0.295s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:01 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info is being set with open permissions: ugo+rw Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:01 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info Sep 28 05:19:01 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:01 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.info" returned: 0 in 0.322s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.202s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496276390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968261b2-ec7c-400c-9c3c-b859e5fa6e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55ca1e6c24b41feac119f027a3701b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:18:58Z,use_quota=True,user_id='300f188f61f6414799bb7f51cb36b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Creating volume 968261b2-ec7c-400c-9c3c-b859e5fa6e97 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:01 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:01 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 1073741824 Sep 28 05:19:01 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-df53d21b-3385-4613-a77b-bcf05d03e0a8 tempest-CreateVolumesFromSnapshotTest-342725436 None] Create snapshot completed successfully Sep 28 05:19:02 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 1073741824" returned: 0 in 0.572s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:02 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 Sep 28 05:19:02 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:02 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97" returned: 0 in 0.309s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11670d7c-e754-4e10-b4e0-d98d0a311282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac119ae-f6f2-4f9a-8792-8df47349f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:02 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Volume volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 (968261b2-ec7c-400c-9c3c-b859e5fa6e97): created successfully Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac119ae-f6f2-4f9a-8792-8df47349f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Flow 'volume_create_manager' (d54c2c93-7c8a-44a6-9b91-bb119248221d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-40959138-192a-40c0-a704-db2b9a3ab5ff tempest-ProjectReaderTests-1247691678 None] Created volume successfully. Sep 28 05:19:03 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a" returned: 0 in 2.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cf8d7db-9851-461c-94d0-a979c9e2e98b_vo1_q4rodevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:19:03 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Converted 112.00 MB image at 48.05 MB/s Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:03 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1G Sep 28 05:19:03 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (26db274f-8e7f-4bc7-9cd1-cf63ecf098de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb4c0c1-9a71-415a-a27a-e63fa1ed0d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb4c0c1-9a71-415a-a27a-e63fa1ed0d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486078638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7e122-7a2c-4a3b-ac1a-a0823d83f290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:03Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8bf38c-e13c-4f19-a59b-ada96e521fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8bf38c-e13c-4f19-a59b-ada96e521fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a449ac6-2f6c-426b-96e4-a64f2f0f0388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a449ac6-2f6c-426b-96e4-a64f2f0f0388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d7e122-7a2c-4a3b-ac1a-a0823d83f290', 'volume_name': 'volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549291b5-1a8a-4d42-b987-6731fd95e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549291b5-1a8a-4d42-b987-6731fd95e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40865e37-b4e3-4ced-8cc6-6a393a8d0c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume 75d7e122-7a2c-4a3b-ac1a-a0823d83f290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290', 'volume_size': 1} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486078638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d7e122-7a2c-4a3b-ac1a-a0823d83f290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:03Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume 75d7e122-7a2c-4a3b-ac1a-a0823d83f290 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:03 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a 1G" returned: 0 in 0.484s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Downloaded image 1cf8d7db-9851-461c-94d0-a979c9e2e98b ((None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}])) to volume 17ebf331-5988-4f6e-ac6e-89bf8723926a successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Temporary image 1cf8d7db-9851-461c-94d0-a979c9e2e98b for user aaf421dbd82a459083c5cbdf6872a0b9 is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Marking volume 17ebf331-5988-4f6e-ac6e-89bf8723926a as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Copying metadata from image 1cf8d7db-9851-461c-94d0-a979c9e2e98b to 17ebf331-5988-4f6e-ac6e-89bf8723926a. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Creating volume glance metadata for volume 17ebf331-5988-4f6e-ac6e-89bf8723926a backed by image 1cf8d7db-9851-461c-94d0-a979c9e2e98b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:19:03 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 1073741824 Sep 28 05:19:03 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb86df-a611-41e6-b7f2-58662657dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ebf331-5988-4f6e-ac6e-89bf8723926a', 'volume_size': 1, 'image_id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd904632e913b4d3c8d3fb5070d04d97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cf8d7db-9851-461c-94d0-a979c9e2e98b', 'created_at': datetime.datetime(2026, 9, 28, 2, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 2, 58, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cf8d7db-9851-461c-94d0-a979c9e2e98b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1896581d-c3d6-4b64-b2bb-e48fe4abe052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Volume volume-17ebf331-5988-4f6e-ac6e-89bf8723926a (17ebf331-5988-4f6e-ac6e-89bf8723926a): created successfully Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1896581d-c3d6-4b64-b2bb-e48fe4abe052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (0c1047f7-a874-4eb4-97b0-a733eb43df42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4440ece9-a874-4394-934d-b87e019cfdf4 tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (ed27c7f8-2811-4d3d-b078-9f1771ab14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6abf411-27a2-41a3-a777-baace1baa3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6abf411-27a2-41a3-a777-baace1baa3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468006913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eee028-5806-42b5-b980-4eb43990e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:04Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01220890-a34c-4a49-b4db-3044a52a04e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01220890-a34c-4a49-b4db-3044a52a04e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895de2e9-d69d-4574-b0d5-2ff6be05c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895de2e9-d69d-4574-b0d5-2ff6be05c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1eee028-5806-42b5-b980-4eb43990e3ec', 'volume_name': 'volume-d1eee028-5806-42b5-b980-4eb43990e3ec', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5b770b-ff9e-4c70-84e9-f2f14472adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5b770b-ff9e-4c70-84e9-f2f14472adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff93e5a5-419c-455b-a8ca-797dc2ee9da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume d1eee028-5806-42b5-b980-4eb43990e3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1eee028-5806-42b5-b980-4eb43990e3ec', 'volume_size': 1} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "cinder-968261b2-ec7c-400c-9c3c-b859e5fa6e97-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-968261b2-ec7c-400c-9c3c-b859e5fa6e97-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "cinder-quobyte-968261b2-ec7c-400c-9c3c-b859e5fa6e97" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-quobyte-968261b2-ec7c-400c-9c3c-b859e5fa6e97" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72428311-ed5f-42f8-a14e-3c55c39afb99]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (c878c8af-8ab0-40c3-9f08-d46d52136bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9405793-c6c3-4c6d-b865-48df32abcde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9405793-c6c3-4c6d-b865-48df32abcde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595488414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b849378-3ca1-4dad-a621-8099859e47ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:04Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5134a67-a41d-48c9-be06-518c49f72d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5134a67-a41d-48c9-be06-518c49f72d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8cbf00-43e5-4374-b5f6-4ae041b74069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8cbf00-43e5-4374-b5f6-4ae041b74069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b849378-3ca1-4dad-a621-8099859e47ad', 'volume_name': 'volume-3b849378-3ca1-4dad-a621-8099859e47ad', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0ed701-f499-40e2-a4d0-716b5b52f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0ed701-f499-40e2-a4d0-716b5b52f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53c89af-c15c-49d6-9f32-68ecb0ac8064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:04 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume 3b849378-3ca1-4dad-a621-8099859e47ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b849378-3ca1-4dad-a621-8099859e47ad', 'volume_size': 1} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 1073741824" returned: 0 in 1.032s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:04 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 Sep 28 05:19:04 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:04 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 Sep 28 05:19:04 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:04 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97" returned: 0 in 0.621s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:05 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97 Sep 28 05:19:05 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:05 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" returned: 0 in 0.566s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468006913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eee028-5806-42b5-b980-4eb43990e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:04Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume d1eee028-5806-42b5-b980-4eb43990e3ec {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:05 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:05 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec 1073741824 Sep 28 05:19:05 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40865e37-b4e3-4ced-8cc6-6a393a8d0c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0061c-0aea-44e1-9ccd-7180ebc3b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 (75d7e122-7a2c-4a3b-ac1a-a0823d83f290): created successfully Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0061c-0aea-44e1-9ccd-7180ebc3b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (26db274f-8e7f-4bc7-9cd1-cf63ecf098de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (7f4dd376-3de4-4e14-aa53-e8a1aa61c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d371ae98-0fec-4545-94a8-a515e2cda066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f1c284a6-4c24-48e0-80d4-d0f5590e00e6 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d371ae98-0fec-4545-94a8-a515e2cda066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1605752696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e996c82-30cc-482b-b1c7-8c952880a0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:05Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb2d6f8-d785-4d58-818f-6723f60a8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb2d6f8-d785-4d58-818f-6723f60a8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2694db22-2df2-4593-a41f-d3041b192faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2694db22-2df2-4593-a41f-d3041b192faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e996c82-30cc-482b-b1c7-8c952880a0d8', 'volume_name': 'volume-5e996c82-30cc-482b-b1c7-8c952880a0d8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b091b37e-f4de-4969-b814-8941a174bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b091b37e-f4de-4969-b814-8941a174bae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69016f3-abaa-42a9-bb4c-5f7827fa859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume 5e996c82-30cc-482b-b1c7-8c952880a0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e996c82-30cc-482b-b1c7-8c952880a0d8', 'volume_size': 1} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:05 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-968261b2-ec7c-400c-9c3c-b859e5fa6e97" returned: 0 in 0.614s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-quobyte-968261b2-ec7c-400c-9c3c-b859e5fa6e97" released by "delete_volume" :: held 1.308s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (bb4cb13e-b672-405b-a243-22550740fdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6eed07-b484-4b7e-950d-c98e527859fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6eed07-b484-4b7e-950d-c98e527859fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-749561371',display_name='tempest-VolumesGetTest-Volume-23296685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ca23ef-3b74-4d2d-9d85-0da44189a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:06Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ea6dd-5f5d-460f-b09a-0046d548b208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ea6dd-5f5d-460f-b09a-0046d548b208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b00b4bf-0a51-482e-a095-aa1be738dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b00b4bf-0a51-482e-a095-aa1be738dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ca23ef-3b74-4d2d-9d85-0da44189a9ba', 'volume_name': 'volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7e55d-2ede-4174-9323-a13ca66938ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7e55d-2ede-4174-9323-a13ca66938ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6967a88-844a-4401-bfdf-a43ad95c5c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:05 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Volume e4ca23ef-3b74-4d2d-9d85-0da44189a9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba', 'volume_size': 1} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Created reservations ['e3455601-683b-44d2-89d7-ed987f07d715', '79245af2-defd-47b8-ad2d-d31e361c37b8', '22be8dd0-c0b7-47e6-aedf-6b5cd66df9ac', '8a4be460-ad97-436f-8798-93619bfbd736'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:05 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec 1073741824" returned: 0 in 0.694s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:05 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:05 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (2e767291-26d4-449a-ae8b-a6bdb3b0c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:05 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a6e4b-2575-4e9c-864c-6f4ec58bd2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:06 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a6e4b-2575-4e9c-864c-6f4ec58bd2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740549243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa749a6e-3c68-4df4-a88f-d1284990db11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:06Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c349c2-cb35-437d-b023-c97846a84d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c349c2-cb35-437d-b023-c97846a84d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8a5182-0151-4acd-9a6d-973309a06000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8a5182-0151-4acd-9a6d-973309a06000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa749a6e-3c68-4df4-a88f-d1284990db11', 'volume_name': 'volume-fa749a6e-3c68-4df4-a88f-d1284990db11', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d973d5c-8269-4c1d-a206-c7432635eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d973d5c-8269-4c1d-a206-c7432635eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ef9521-e1df-49eb-b0f0-e402e999821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume fa749a6e-3c68-4df4-a88f-d1284990db11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa749a6e-3c68-4df4-a88f-d1284990db11', 'volume_size': 1} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:06 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Deleted volume successfully. Sep 28 05:19:06 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec" returned: 0 in 0.350s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4238d9b1-9e37-4e2f-8329-c03a4730ea68 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-968261b2-ec7c-400c-9c3c-b859e5fa6e97-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595488414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b849378-3ca1-4dad-a621-8099859e47ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:04Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume 3b849378-3ca1-4dad-a621-8099859e47ad {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:06 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:06 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad 1073741824 Sep 28 05:19:06 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff93e5a5-419c-455b-a8ca-797dc2ee9da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1eee028-5806-42b5-b980-4eb43990e3ec', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0129c635-468a-4334-b101-2e5c014bdf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-d1eee028-5806-42b5-b980-4eb43990e3ec (d1eee028-5806-42b5-b980-4eb43990e3ec): created successfully Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0129c635-468a-4334-b101-2e5c014bdf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (ed27c7f8-2811-4d3d-b078-9f1771ab14ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-caacff4f-1cc4-4f5d-ad6b-b5b9b027e044 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:19:07 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad 1073741824" returned: 0 in 0.623s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:07 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad Sep 28 05:19:07 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Flow 'volume_create_manager' (9676ee70-717d-472b-aab2-8b3af6416321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec1442d-d71a-4509-8972-1d271f387d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec1442d-d71a-4509-8972-1d271f387d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705446642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe4e0aa-1d51-4092-a617-e19d46293436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55ca1e6c24b41feac119f027a3701b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:07Z,use_quota=True,user_id='300f188f61f6414799bb7f51cb36b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b36f0b7-5167-431a-b072-89abfbf34bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b36f0b7-5167-431a-b072-89abfbf34bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2deafe-19b6-45bd-bbe5-15d857e763e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2deafe-19b6-45bd-bbe5-15d857e763e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe4e0aa-1d51-4092-a617-e19d46293436', 'volume_name': 'volume-efe4e0aa-1d51-4092-a617-e19d46293436', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad98fb8b-136b-496e-9350-79289a7f9857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad98fb8b-136b-496e-9350-79289a7f9857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba9d0e-c774-4ead-9cd4-dd9ec33dd3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Volume efe4e0aa-1d51-4092-a617-e19d46293436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe4e0aa-1d51-4092-a617-e19d46293436', 'volume_size': 1} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad" returned: 0 in 0.279s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1605752696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e996c82-30cc-482b-b1c7-8c952880a0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:05Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume 5e996c82-30cc-482b-b1c7-8c952880a0d8 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:07 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53c89af-c15c-49d6-9f32-68ecb0ac8064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b849378-3ca1-4dad-a621-8099859e47ad', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fd82f9-28c4-4519-8faa-2aa429374701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:07 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 1073741824 Sep 28 05:19:07 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-3b849378-3ca1-4dad-a621-8099859e47ad (3b849378-3ca1-4dad-a621-8099859e47ad): created successfully Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fd82f9-28c4-4519-8faa-2aa429374701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (c878c8af-8ab0-40c3-9f08-d46d52136bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6f28ab6a-f30f-4f45-a73c-acdb3684806b tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:19:07 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 1073741824" returned: 0 in 0.429s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:07 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 Sep 28 05:19:07 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:08 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-749561371',display_name='tempest-VolumesGetTest-Volume-23296685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ca23ef-3b74-4d2d-9d85-0da44189a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b48b0418d1d48d2843faaae30fb1989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:06Z,use_quota=True,user_id='aaf421dbd82a459083c5cbdf6872a0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Creating volume e4ca23ef-3b74-4d2d-9d85-0da44189a9ba {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:08 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69016f3-abaa-42a9-bb4c-5f7827fa859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e996c82-30cc-482b-b1c7-8c952880a0d8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba 1073741824 Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909d7afe-4bd4-4e14-a355-797219fb6b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 (5e996c82-30cc-482b-b1c7-8c952880a0d8): created successfully Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909d7afe-4bd4-4e14-a355-797219fb6b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (7f4dd376-3de4-4e14-aa53-e8a1aa61c778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4cd83f0d-3232-41f6-a48a-fc6174e7a917 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:19:08 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba 1073741824" returned: 0 in 0.544s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:08 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba Sep 28 05:19:08 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Flow 'volume_create_manager' (abccd5dd-fdea-4eec-837f-a7e72f23e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3360bac6-68a7-4533-bdf0-343c1f351b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3360bac6-68a7-4533-bdf0-343c1f351b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1386863592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4860ccf6-3657-41a6-96a7-05ae2e378a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6e130e348f44958a7b1fab52aec433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90b19385-08c6-40b5-9bc8-d8ee1524c12a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:09Z,use_quota=True,user_id='f605efa217174c4881b6eddbd42f8ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2507f05b-7af2-4602-bb88-6f61e5b65488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2507f05b-7af2-4602-bb88-6f61e5b65488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c480650f-8282-4cd5-8502-c84ac750578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c480650f-8282-4cd5-8502-c84ac750578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4860ccf6-3657-41a6-96a7-05ae2e378a60', 'volume_name': 'volume-4860ccf6-3657-41a6-96a7-05ae2e378a60', 'volume_size': 1, 'snapshot_id': '90b19385-08c6-40b5-9bc8-d8ee1524c12a'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79efdd88-548e-442c-b926-c48b25c491ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79efdd88-548e-442c-b926-c48b25c491ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd95976e-f8e7-4096-a97d-65e560e37079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:08 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Volume 4860ccf6-3657-41a6-96a7-05ae2e378a60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4860ccf6-3657-41a6-96a7-05ae2e378a60', 'volume_size': 1, 'snapshot_id': '90b19385-08c6-40b5-9bc8-d8ee1524c12a'} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:08 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" returned: 0 in 0.276s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.878s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740549243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa749a6e-3c68-4df4-a88f-d1284990db11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9d3888ea84e9fa3f89281c6b20bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:06Z,use_quota=True,user_id='058b25f042424a9c917ef6789aacfcad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Creating volume fa749a6e-3c68-4df4-a88f-d1284990db11 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:08 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6967a88-844a-4401-bfdf-a43ad95c5c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:09 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 1073741824 Sep 28 05:19:09 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10beaa14-acf3-4d0f-8a4c-18249f409b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Volume volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba (e4ca23ef-3b74-4d2d-9d85-0da44189a9ba): created successfully Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10beaa14-acf3-4d0f-8a4c-18249f409b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Flow 'volume_create_manager' (bb4cb13e-b672-405b-a243-22550740fdee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-17fad445-efeb-4ef2-b6ed-150c6b39aaf1 tempest-VolumesGetTest-621595968 None] Created volume successfully. Sep 28 05:19:09 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 1073741824" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:09 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 Sep 28 05:19:09 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:09 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705446642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe4e0aa-1d51-4092-a617-e19d46293436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55ca1e6c24b41feac119f027a3701b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:07Z,use_quota=True,user_id='300f188f61f6414799bb7f51cb36b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Creating volume efe4e0aa-1d51-4092-a617-e19d46293436 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:09 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ef9521-e1df-49eb-b0f0-e402e999821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa749a6e-3c68-4df4-a88f-d1284990db11', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:09 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 1073741824 Sep 28 05:19:09 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03d901f-2fb9-4a7c-afaa-516a48002034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Volume volume-fa749a6e-3c68-4df4-a88f-d1284990db11 (fa749a6e-3c68-4df4-a88f-d1284990db11): created successfully Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03d901f-2fb9-4a7c-afaa-516a48002034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Flow 'volume_create_manager' (2e767291-26d4-449a-ae8b-a6bdb3b0c240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dc8cc107-9a11-4c39-be65-579cc81e7806 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created volume successfully. Sep 28 05:19:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "cinder-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888f69e-d57b-45b1-a1d0-720603196c24]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:10 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba Sep 28 05:19:10 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-fa749a6e-3c68-4df4-a88f-d1284990db11-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 1073741824" returned: 0 in 0.617s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-fa749a6e-3c68-4df4-a88f-d1284990db11-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:10 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 Sep 28 05:19:10 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-fa749a6e-3c68-4df4-a88f-d1284990db11" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-fa749a6e-3c68-4df4-a88f-d1284990db11" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[633cde95-6cc8-439f-afef-c7d5ce5ca736]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:10 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" returned: 0 in 0.495s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:10 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba Sep 28 05:19:10 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:10 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 Sep 28 05:19:10 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:10 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436" returned: 0 in 0.384s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.957s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a-4860ccf6-3657-41a6-96a7-05ae2e378a60" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba9d0e-c774-4ead-9cd4-dd9ec33dd3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe4e0aa-1d51-4092-a617-e19d46293436', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a304efba-5f87-4dcc-98a4-bf0af2c3ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a-4860ccf6-3657-41a6-96a7-05ae2e378a60" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Creating volume 4860ccf6-3657-41a6-96a7-05ae2e378a60 from snapshot 90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Volume volume-efe4e0aa-1d51-4092-a617-e19d46293436 (efe4e0aa-1d51-4092-a617-e19d46293436): created successfully Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a304efba-5f87-4dcc-98a4-bf0af2c3ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Flow 'volume_create_manager' (9676ee70-717d-472b-aab2-8b3af6416321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" acquired by "_copy_volume_from_snapshot" :: waited 0.067s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] snapshot: 90b19385-08c6-40b5-9bc8-d8ee1524c12a, volume: 4860ccf6-3657-41a6-96a7-05ae2e378a60, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:19:11 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" returned: 0 in 0.396s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6e88c969-0d24-4917-8972-b35a804c2429 tempest-ProjectReaderTests-1247691678 None] Created volume successfully. Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba" released by "delete_volume" :: held 1.011s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:11 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4dc1db-0844-4601-9b4e-e7634c9ab32b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11" returned: 0 in 0.588s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:11 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11 Sep 28 05:19:11 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Created reservations ['78865aeb-08c0-4d2b-a89a-147724f5449b', 'a4afcd50-ae9c-4921-92c7-94c887d0a068', 'dbab46ea-139b-4e6e-a465-e751d81b88f8', '43ed850a-35f8-4be7-85b8-54aa401cc3b6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:11 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:19:11 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:11 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:11 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "cinder-efe4e0aa-1d51-4092-a617-e19d46293436-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:11 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fa749a6e-3c68-4df4-a88f-d1284990db11" returned: 0 in 0.642s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:11 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.739s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-fa749a6e-3c68-4df4-a88f-d1284990db11" released by "delete_volume" :: held 1.359s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-efe4e0aa-1d51-4092-a617-e19d46293436-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f566e44b-e0a8-4787-989f-7a37cf1f5c4e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "cinder-quobyte-efe4e0aa-1d51-4092-a617-e19d46293436" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['0089919d-812a-4c64-a33f-36f2de1d80da', '1515e60c-d074-4e7e-8650-28bec7747251', '9b827bd4-7c4d-4767-8192-7cda16ccaa6c', 'd0ba6455-6a04-4061-8db9-b131d23aa4b6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-quobyte-efe4e0aa-1d51-4092-a617-e19d46293436" acquired by "delete_volume" :: waited 0.061s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:12 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:19:12 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e834fa61-47ad-4c66-8a26-58c5db4ddeb0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:12 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.801s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:19:12 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:12 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8447c7d1-815a-4bca-9d74-8e5d3b109f5c tempest-VolumesGetTest-621595968 None] Lock "cinder-e4ca23ef-3b74-4d2d-9d85-0da44189a9ba-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-17ebf331-5988-4f6e-ac6e-89bf8723926a-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:12 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 Sep 28 05:19:12 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "cinder-17ebf331-5988-4f6e-ac6e-89bf8723926a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Acquiring lock "cinder-quobyte-17ebf331-5988-4f6e-ac6e-89bf8723926a" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-17ebf331-5988-4f6e-ac6e-89bf8723926a" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10840815-83dd-4199-9eb1-4ff9db0c5d23]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:12 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.856s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:12 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 Sep 28 05:19:12 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-5e996c82-30cc-482b-b1c7-8c952880a0d8-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:12 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436" returned: 0 in 0.816s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:12 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:13 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a Sep 28 05:19:13 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-5e996c82-30cc-482b-b1c7-8c952880a0d8-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.731s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:13 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436 Sep 28 05:19:13 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-943def36-597d-4506-adad-d3d7d675197f tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-fa749a6e-3c68-4df4-a88f-d1284990db11-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-5e996c82-30cc-482b-b1c7-8c952880a0d8" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-5e996c82-30cc-482b-b1c7-8c952880a0d8" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e0db4-b40e-4f85-8710-3d9665bc00bc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:13 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-efe4e0aa-1d51-4092-a617-e19d46293436" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:13 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 Sep 28 05:19:13 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-quobyte-efe4e0aa-1d51-4092-a617-e19d46293436" released by "delete_volume" :: held 1.440s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:13 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a" returned: 0 in 0.918s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:13 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a Sep 28 05:19:13 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:13 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Created reservations ['efa1dbdf-6a2e-41a0-b573-85710b5c9800', '0d1933d3-d781-4095-9c3e-705d690df0eb', 'fb3fade1-dabc-4eda-ae75-cf9f1e982f74', 'b0ff86f2-55c6-4adc-b666-bc4571be276f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:14 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:14 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:14 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8" returned: 0 in 0.943s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:14 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-17ebf331-5988-4f6e-ac6e-89bf8723926a" returned: 0 in 0.628s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:14 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8 Sep 28 05:19:14 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "cinder-quobyte-17ebf331-5988-4f6e-ac6e-89bf8723926a" released by "delete_volume" :: held 1.658s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Created reservations ['77b462bd-e26e-425f-9979-50c2cc2844ac', 'e08f5060-d062-49d5-82b9-1121c7b53819', 'b3b7a1ef-8075-41eb-ae21-40b57b1ccad9', 'e1211ed8-ec1e-4247-8e3b-817cc06c27c0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:14 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.925s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:14 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Deleted volume successfully. Sep 28 05:19:15 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:15 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:15 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79f2effd-5baa-4c1d-820f-008821e561a6 tempest-ProjectReaderTests-1247691678 None] Lock "cinder-efe4e0aa-1d51-4092-a617-e19d46293436-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5e996c82-30cc-482b-b1c7-8c952880a0d8" returned: 0 in 0.900s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-5e996c82-30cc-482b-b1c7-8c952880a0d8" released by "delete_volume" :: held 1.941s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['26134177-efee-4e5b-a29c-c49302c89309', 'f2c27544-b792-4b20-afb7-78892da7d14a', 'acbbdaf7-df52-4001-b8c9-d28e6fa773df', 'e420c086-31ef-4940-9f7c-56baa9788215'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:15 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.624s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Deleted volume successfully. Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a420b549-88f8-4074-a854-90ba652ba529 tempest-VolumesGetTest-621595968 None] Lock "cinder-17ebf331-5988-4f6e-ac6e-89bf8723926a-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:15 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:15 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-3b849378-3ca1-4dad-a621-8099859e47ad-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-3b849378-3ca1-4dad-a621-8099859e47ad-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-3b849378-3ca1-4dad-a621-8099859e47ad" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-3b849378-3ca1-4dad-a621-8099859e47ad" acquired by "delete_volume" :: waited 0.057s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d7a8a-86bd-43c1-858e-5396bb82d94b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:16 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.889s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:16 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad Sep 28 05:19:16 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d0fad139-138b-4a5f-ae47-7efac75b5342 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-5e996c82-30cc-482b-b1c7-8c952880a0d8-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:17 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad" returned: 0 in 1.306s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:17 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad Sep 28 05:19:17 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:18 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3b849378-3ca1-4dad-a621-8099859e47ad" returned: 0 in 0.905s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-3b849378-3ca1-4dad-a621-8099859e47ad" released by "delete_volume" :: held 2.341s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['320bdd80-61c2-4eb0-8fe3-459ad0b4ecf6', 'f565dc24-81f6-49f9-8df9-9518b97e95c1', '3968eee3-b634-4f12-b56a-88b12107048b', '9225ff15-4d00-49f5-8d45-2dc6d844ff66'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:18 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:18 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:19 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.450s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fbfff954-b80f-4a33-b28d-80429e8c4ce1 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-3b849378-3ca1-4dad-a621-8099859e47ad-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-d1eee028-5806-42b5-b980-4eb43990e3ec-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-d1eee028-5806-42b5-b980-4eb43990e3ec-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-d1eee028-5806-42b5-b980-4eb43990e3ec" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-d1eee028-5806-42b5-b980-4eb43990e3ec" acquired by "delete_volume" :: waited 0.035s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6813c3-449b-4bcd-a39c-9a73eb846a21]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:20 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec Sep 28 05:19:20 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:21 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec" returned: 0 in 1.228s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:21 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec Sep 28 05:19:21 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:22 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d1eee028-5806-42b5-b980-4eb43990e3ec" returned: 0 in 0.860s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-d1eee028-5806-42b5-b980-4eb43990e3ec" released by "delete_volume" :: held 2.198s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['839b88c1-2304-4726-b205-f43d5a6ae2f2', 'd9929910-a9e3-4cb1-9c84-21657feba503', '9a1900cf-6741-404f-9679-3b78184bfe94', '5308ec80-e479-4f41-b156-7c4bf884d059'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:22 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:22 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:23 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.714s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-5450bcad-044a-4965-9bd3-60ae76baf114 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-d1eee028-5806-42b5-b980-4eb43990e3ec-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-75d7e122-7a2c-4a3b-ac1a-a0823d83f290-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-75d7e122-7a2c-4a3b-ac1a-a0823d83f290-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" acquired by "delete_volume" :: waited 0.047s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc3ad18-d6ab-4717-9c39-48a21a209a02]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:24 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 Sep 28 05:19:24 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:24 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" returned: 0 in 1.013s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60" returned: 0 in 12.010s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:24 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf, size 1024.00 MB, duration 12.01 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:19:24 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Converted 1024.00 MB image at 85.26 MB/s Sep 28 05:19:24 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 is being set with open permissions: ugo+rw Sep 28 05:19:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:24 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290 Sep 28 05:19:24 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:24 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 Sep 28 05:19:24 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:25 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" released by "_copy_volume_from_snapshot" :: held 14.245s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a-4860ccf6-3657-41a6-96a7-05ae2e378a60" released by "_create_volume_from_snapshot" :: held 14.422s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.484s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:25 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" returned: 0 in 0.595s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-75d7e122-7a2c-4a3b-ac1a-a0823d83f290" released by "delete_volume" :: held 1.723s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd95976e-f8e7-4096-a97d-65e560e37079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4860ccf6-3657-41a6-96a7-05ae2e378a60', 'volume_size': 1, 'snapshot_id': '90b19385-08c6-40b5-9bc8-d8ee1524c12a'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c3237-460d-4e77-8ef8-a5cbef8db4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:25 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Volume volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 (4860ccf6-3657-41a6-96a7-05ae2e378a60): created successfully Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c3237-460d-4e77-8ef8-a5cbef8db4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Flow 'volume_create_manager' (abccd5dd-fdea-4eec-837f-a7e72f23e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8ba8294c-80a4-4a42-819c-a3a4fe14627a tempest-TestStampPattern-643231710 None] Created volume successfully. Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['20410c4e-6bed-4551-82b9-42fa45031e27', '57c443d9-076b-49f1-a69f-35d217556e89', 'bf1de62c-f7db-4652-a79b-e1424f5dc863', '3789e6fc-fabc-489a-acdd-0cfffa519b16'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:25 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:25 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:26 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.504s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:26 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleting offline snapshot a5474d3b-4b76-4608-9537-0c9f4ee3cd2a of volume ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] snapshot_file for this snap is: volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce19a35d-70fa-4af4-85ff-af5a43306842]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8b3d7299-6252-4ffe-bd21-2267d6842c89 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-75d7e122-7a2c-4a3b-ac1a-a0823d83f290-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Flow 'volume_create_manager' (e0a8f813-b1e3-4200-8c04-3ba8c2599e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0647b3-9e20-48cc-a96a-2bdea011eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0647b3-9e20-48cc-a96a-2bdea011eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2038501357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fe5ad8-bfec-4028-8553-f4aa9c22c121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b798d370bd954901906c2afa0b5f55fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:26Z,use_quota=True,user_id='a2ee76be77474214a228bcb9d2b38152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9c79ae-dfef-4efd-983f-eb839edc3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9c79ae-dfef-4efd-983f-eb839edc3f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a49e91f-f0a3-4232-95b0-67dff35cc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a49e91f-f0a3-4232-95b0-67dff35cc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fe5ad8-bfec-4028-8553-f4aa9c22c121', 'volume_name': 'volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59f6c5b-850c-4c5b-868b-0fbf33e13750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59f6c5b-850c-4c5b-868b-0fbf33e13750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c0d9bd-f099-40c7-903c-2268635dfcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:26 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a Sep 28 05:19:26 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Volume 22fe5ad8-bfec-4028-8553-f4aa9c22c121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121', 'volume_size': 1} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2038501357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fe5ad8-bfec-4028-8553-f4aa9c22c121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b798d370bd954901906c2afa0b5f55fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:26Z,use_quota=True,user_id='a2ee76be77474214a228bcb9d2b38152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Creating volume 22fe5ad8-bfec-4028-8553-f4aa9c22c121 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:26 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:26 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 1073741824 Sep 28 05:19:26 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:26 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" returned: 0 in 0.694s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef0ce854-7121-496a-8894-ad127e4f39b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c4697-d5b7-4616-8d01-5153d77e9ab8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:27 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 1073741824" returned: 0 in 0.711s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:27 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 Sep 28 05:19:27 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:27 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 Sep 28 05:19:27 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:27 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5" returned: 0 in 0.732s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:27 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121" returned: 0 in 0.454s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:27 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:27 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c0d9bd-f099-40c7-903c-2268635dfcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed75fe23-c586-4dfb-adaa-1bbc8e247fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Volume volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 (22fe5ad8-bfec-4028-8553-f4aa9c22c121): created successfully Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed75fe23-c586-4dfb-adaa-1bbc8e247fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Flow 'volume_create_manager' (e0a8f813-b1e3-4200-8c04-3ba8c2599e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-19f7ad81-3d1b-4a36-ba9c-b792d5bc6b50 tempest-VolumesNegativeTest-64322066 None] Created volume successfully. Sep 28 05:19:28 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" returned: 0 in 0.513s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:28 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a Sep 28 05:19:28 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:28 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5.a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" returned: 0 in 0.561s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a" released by "_delete_snapshot" :: held 2.697s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" released by "delete_snapshot" :: held 2.756s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:28 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['f5115dc1-a51e-4448-93f4-5a6d34caf7be', '149706f6-0b99-44c7-bfb4-a2bda6874112', '8fc20c70-5a41-477f-b6d1-be548bba8747', 'ef568659-3d08-4189-b853-23301de63a32'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Delete snapshot completed successfully. Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-87043f90-a0fc-4013-b23c-f7250b694fac tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-a5474d3b-4b76-4608-9537-0c9f4ee3cd2a-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-ef0ce854-7121-496a-8894-ad127e4f39b5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:29 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:29 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-ef0ce854-7121-496a-8894-ad127e4f39b5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a63669c-dc87-4301-9ceb-dadf1871dafc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:29 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.593s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:19:30 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 Sep 28 05:19:30 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:30 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5" returned: 0 in 0.788s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:30 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5 Sep 28 05:19:30 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:31 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ef0ce854-7121-496a-8894-ad127e4f39b5" returned: 0 in 0.489s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-quobyte-ef0ce854-7121-496a-8894-ad127e4f39b5" released by "delete_volume" :: held 1.425s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Created reservations ['040b0530-c10e-4edc-8e2f-151f9aa35a10', '03725217-02df-42c4-97e4-97aee6700426', '6ab951fe-0ffa-4dbe-9cfe-091b47d7e25c', 'b262e165-5aa8-4d85-ada4-9bd7ac5aa049'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:31 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:31 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:32 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.810s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:32 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Deleted volume successfully. Sep 28 05:19:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-65bbd8af-dad0-4cfa-ade9-9e2d7e61e479 tempest-CreateVolumesFromSnapshotTest-342725436 None] Lock "cinder-ef0ce854-7121-496a-8894-ad127e4f39b5-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=163,cinder:INSERT=61,cinder:UPDATE=202,cinder:DELETE=19 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=144,cinder:INSERT=50,cinder:UPDATE=221,cinder:DELETE=18 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (30b8f8e4-4e9c-45c8-925b-de5361c7916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0f4431-029b-4893-a8b3-d89aee82cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0f4431-029b-4893-a8b3-d89aee82cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664820230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd9e83f-010f-4966-9c11-e9846585c32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:37Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276677ac-11bd-4f7c-86c3-4369cffee54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276677ac-11bd-4f7c-86c3-4369cffee54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c7d47d-b674-4efe-aedd-2fa5ec170e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c7d47d-b674-4efe-aedd-2fa5ec170e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd9e83f-010f-4966-9c11-e9846585c32d', 'volume_name': 'volume-0cd9e83f-010f-4966-9c11-e9846585c32d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52062c2b-cfea-4846-8a01-677fe165c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52062c2b-cfea-4846-8a01-677fe165c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86a3b70-39dd-49e9-9a14-8fe20fe62dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume 0cd9e83f-010f-4966-9c11-e9846585c32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd9e83f-010f-4966-9c11-e9846585c32d', 'volume_size': 1} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664820230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd9e83f-010f-4966-9c11-e9846585c32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:37Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume 0cd9e83f-010f-4966-9c11-e9846585c32d {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:37 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d 1073741824 Sep 28 05:19:37 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:38 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d 1073741824" returned: 0 in 1.122s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:38 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d Sep 28 05:19:38 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:38 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d" returned: 0 in 0.274s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86a3b70-39dd-49e9-9a14-8fe20fe62dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd9e83f-010f-4966-9c11-e9846585c32d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffbe73b-e410-49ae-ab0f-111640e67d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-0cd9e83f-010f-4966-9c11-e9846585c32d (0cd9e83f-010f-4966-9c11-e9846585c32d): created successfully Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffbe73b-e410-49ae-ab0f-111640e67d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (30b8f8e4-4e9c-45c8-925b-de5361c7916f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e5a745a2-862d-44e7-9377-ddbbfff59497 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (e1405de4-5cd3-428c-93df-7237597e9223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7b1003-c301-4f76-86d1-17d88f87d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7b1003-c301-4f76-86d1-17d88f87d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226530343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc552dd9-09c9-4150-8312-ef40967be41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:41Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea27725-1648-41c4-a3a4-5a05244ce841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea27725-1648-41c4-a3a4-5a05244ce841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a94f74-505a-44c3-8685-15e4f22471cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a94f74-505a-44c3-8685-15e4f22471cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc552dd9-09c9-4150-8312-ef40967be41f', 'volume_name': 'volume-fc552dd9-09c9-4150-8312-ef40967be41f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ee712e-40e2-42c5-9a1f-3d7e3790b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ee712e-40e2-42c5-9a1f-3d7e3790b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58660617-5f19-4ddb-bb2a-2aa184891257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:40 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume fc552dd9-09c9-4150-8312-ef40967be41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc552dd9-09c9-4150-8312-ef40967be41f', 'volume_size': 1} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226530343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc552dd9-09c9-4150-8312-ef40967be41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:41Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume fc552dd9-09c9-4150-8312-ef40967be41f {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:40 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:40 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f 1073741824 Sep 28 05:19:40 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (56d60036-47e5-4764-8a6d-d4f5290b97fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad306913-fe2a-4028-b9b3-6311134bd2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad306913-fe2a-4028-b9b3-6311134bd2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053024696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157394c-019d-49e0-9fee-a5027b006848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:41Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9be5a6c-d471-4edc-a788-5af25305cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9be5a6c-d471-4edc-a788-5af25305cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cf5b3d-9ebc-462c-9b81-2efd40439eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cf5b3d-9ebc-462c-9b81-2efd40439eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4157394c-019d-49e0-9fee-a5027b006848', 'volume_name': 'volume-4157394c-019d-49e0-9fee-a5027b006848', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1935b3e-c720-4c41-910e-7538462706c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1935b3e-c720-4c41-910e-7538462706c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076cc63d-cf9f-44db-ba33-7bda19e5ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume 4157394c-019d-49e0-9fee-a5027b006848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4157394c-019d-49e0-9fee-a5027b006848', 'volume_size': 1} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (3030bdfb-20ff-4258-82aa-e35c62b7aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1156662-3400-4729-98a7-fba3ef9acd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1156662-3400-4729-98a7-fba3ef9acd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120663222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e302f54-db3e-48f6-9f6e-e72cca3529ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:42Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:41 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5f3008-0cae-4dd7-95d9-332ced4e2881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5f3008-0cae-4dd7-95d9-332ced4e2881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbddd9fe-dd04-4b51-84b1-03cd13c77520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbddd9fe-dd04-4b51-84b1-03cd13c77520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e302f54-db3e-48f6-9f6e-e72cca3529ee', 'volume_name': 'volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da962b1b-9613-4b8b-bf51-e94b95761d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da962b1b-9613-4b8b-bf51-e94b95761d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acb8e92-46fd-44ff-9333-5faf258daa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume 4e302f54-db3e-48f6-9f6e-e72cca3529ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee', 'volume_size': 1} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f 1073741824" returned: 0 in 1.199s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:42 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f Sep 28 05:19:42 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (cbbfbb01-246a-4976-8634-42a8d39252f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fb2702-20f4-4921-bba0-d9cc2bf6a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fb2702-20f4-4921-bba0-d9cc2bf6a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681416238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e528cc57-39ee-450f-ad8e-765d3f3675ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:42Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbccbb1-a84d-4ed3-a0c3-f990aae92433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbccbb1-a84d-4ed3-a0c3-f990aae92433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c527285e-08c2-4c96-83e6-66291a416e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c527285e-08c2-4c96-83e6-66291a416e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e528cc57-39ee-450f-ad8e-765d3f3675ff', 'volume_name': 'volume-e528cc57-39ee-450f-ad8e-765d3f3675ff', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e065c5-eda1-47f2-8649-121e650f7f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e065c5-eda1-47f2-8649-121e650f7f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5283cc-592c-4580-bcec-2e7ff293f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume e528cc57-39ee-450f-ad8e-765d3f3675ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e528cc57-39ee-450f-ad8e-765d3f3675ff', 'volume_size': 1} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:42 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053024696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157394c-019d-49e0-9fee-a5027b006848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:41Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume 4157394c-019d-49e0-9fee-a5027b006848 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58660617-5f19-4ddb-bb2a-2aa184891257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc552dd9-09c9-4150-8312-ef40967be41f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c034094f-b7da-4dcd-b45d-b7e73ea6667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 1073741824 Sep 28 05:19:42 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-fc552dd9-09c9-4150-8312-ef40967be41f (fc552dd9-09c9-4150-8312-ef40967be41f): created successfully Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c034094f-b7da-4dcd-b45d-b7e73ea6667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (e1405de4-5cd3-428c-93df-7237597e9223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-65065ebc-28f2-4633-be6a-9bf521d30d66 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (19c46d64-bf4f-41a0-aa28-379a47137249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f4029b-148f-4962-a28a-03defbbac5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f4029b-148f-4962-a28a-03defbbac5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685797710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191895fe-82f2-4c57-8053-4e5a484998bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:43Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d463e0cd-b248-489b-9953-ce8491c5796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d463e0cd-b248-489b-9953-ce8491c5796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e28fe5b-92d2-4075-bd4e-935dad0b93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e28fe5b-92d2-4075-bd4e-935dad0b93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191895fe-82f2-4c57-8053-4e5a484998bc', 'volume_name': 'volume-191895fe-82f2-4c57-8053-4e5a484998bc', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5210dd3e-aabc-48ff-9304-33dfa0ec5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5210dd3e-aabc-48ff-9304-33dfa0ec5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cbb36e-b851-4437-acf0-6e2b2ecbca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume 191895fe-82f2-4c57-8053-4e5a484998bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191895fe-82f2-4c57-8053-4e5a484998bc', 'volume_size': 1} Sep 28 05:19:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:43 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 1073741824" returned: 0 in 0.732s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:43 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 Sep 28 05:19:43 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:43 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120663222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e302f54-db3e-48f6-9f6e-e72cca3529ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:42Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume 4e302f54-db3e-48f6-9f6e-e72cca3529ee {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:43 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:43 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee 1073741824 Sep 28 05:19:43 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076cc63d-cf9f-44db-ba33-7bda19e5ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4157394c-019d-49e0-9fee-a5027b006848', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52698182-bff4-499d-a062-24c767fe627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:43 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-4157394c-019d-49e0-9fee-a5027b006848 (4157394c-019d-49e0-9fee-a5027b006848): created successfully Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52698182-bff4-499d-a062-24c767fe627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:43 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (56d60036-47e5-4764-8a6d-d4f5290b97fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-da7b4b63-be44-4b98-9f46-b844233a0582 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:44 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee 1073741824" returned: 0 in 0.492s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:44 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee Sep 28 05:19:44 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:44 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681416238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e528cc57-39ee-450f-ad8e-765d3f3675ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:42Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume e528cc57-39ee-450f-ad8e-765d3f3675ff {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:44 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acb8e92-46fd-44ff-9333-5faf258daa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:44 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff 1073741824 Sep 28 05:19:44 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac0dd44-4e78-4e03-a98c-05a3523edb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee (4e302f54-db3e-48f6-9f6e-e72cca3529ee): created successfully Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac0dd44-4e78-4e03-a98c-05a3523edb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (3030bdfb-20ff-4258-82aa-e35c62b7aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2aadca4f-bb46-4ac9-8802-5d6e71059ce0 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:44 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff 1073741824" returned: 0 in 0.489s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:45 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff Sep 28 05:19:45 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:45 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff" returned: 0 in 0.252s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.445s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685797710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191895fe-82f2-4c57-8053-4e5a484998bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bac8ead4ba4f1189913eca62f77ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:19:43Z,use_quota=True,user_id='46c22b5fc12b4df988997705bc9073d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Creating volume 191895fe-82f2-4c57-8053-4e5a484998bc {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:19:45 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5283cc-592c-4580-bcec-2e7ff293f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e528cc57-39ee-450f-ad8e-765d3f3675ff', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:45 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc 1073741824 Sep 28 05:19:45 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be7a5b-b79a-49b1-8a17-0b3944001df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-e528cc57-39ee-450f-ad8e-765d3f3675ff (e528cc57-39ee-450f-ad8e-765d3f3675ff): created successfully Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be7a5b-b79a-49b1-8a17-0b3944001df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (cbbfbb01-246a-4976-8634-42a8d39252f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-703035e2-8ce3-410b-a2cc-3ba6636d74ac tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:45 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc 1073741824" returned: 0 in 0.457s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:45 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc Sep 28 05:19:45 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:46 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc" returned: 0 in 0.255s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cbb36e-b851-4437-acf0-6e2b2ecbca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191895fe-82f2-4c57-8053-4e5a484998bc', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71022314-3a76-4757-8363-1ada483b9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:19:46 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Volume volume-191895fe-82f2-4c57-8053-4e5a484998bc (191895fe-82f2-4c57-8053-4e5a484998bc): created successfully Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71022314-3a76-4757-8363-1ada483b9534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:19:46 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Flow 'volume_create_manager' (19c46d64-bf4f-41a0-aa28-379a47137249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:19:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-dac16e49-b1bc-4aa0-8d2e-40ac63422a3d tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created volume successfully. Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-191895fe-82f2-4c57-8053-4e5a484998bc-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-191895fe-82f2-4c57-8053-4e5a484998bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-191895fe-82f2-4c57-8053-4e5a484998bc" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-191895fe-82f2-4c57-8053-4e5a484998bc" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be590c2a-8c75-4a5d-8ee7-0fad6ae7ed3a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:47 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc Sep 28 05:19:47 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:47 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc" returned: 0 in 0.374s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:47 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc Sep 28 05:19:47 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:47 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-191895fe-82f2-4c57-8053-4e5a484998bc" returned: 0 in 0.270s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-191895fe-82f2-4c57-8053-4e5a484998bc" released by "delete_volume" :: held 0.694s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['8edd2ee5-8ef6-45eb-b924-b66b839efb28', '7fae00f9-7cc6-4783-9338-8a4261d4ed4c', 'ac9b90fd-1921-4e32-9072-7643345eff11', '53daaae3-d319-4432-aaf0-1fb1453e67fb'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:48 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:48 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:48 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-e528cc57-39ee-450f-ad8e-765d3f3675ff-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-aea83efd-84aa-409a-902d-82ce816b5fc8 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-191895fe-82f2-4c57-8053-4e5a484998bc-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-e528cc57-39ee-450f-ad8e-765d3f3675ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-e528cc57-39ee-450f-ad8e-765d3f3675ff" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-e528cc57-39ee-450f-ad8e-765d3f3675ff" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694993f-1d75-4aa7-a32b-e6fc7981d995]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:48 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff Sep 28 05:19:48 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:48 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff" returned: 0 in 0.412s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:48 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff Sep 28 05:19:48 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:49 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e528cc57-39ee-450f-ad8e-765d3f3675ff" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-e528cc57-39ee-450f-ad8e-765d3f3675ff" released by "delete_volume" :: held 0.735s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['4049d2a3-7ac6-4e5e-8366-c3e2a13500ca', '291d2e84-4b23-4a12-a450-8fb7889c8d38', '2ee87351-e865-4b0f-aa30-1e2c7168d851', '10245a13-0d2d-4b7e-91ee-27f812994570'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:49 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:49 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-4e302f54-db3e-48f6-9f6e-e72cca3529ee-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-4e302f54-db3e-48f6-9f6e-e72cca3529ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:49 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.317s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-4e302f54-db3e-48f6-9f6e-e72cca3529ee" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ad9243a-985e-451f-b935-dbe131a366a7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-e528cc57-39ee-450f-ad8e-765d3f3675ff-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-4e302f54-db3e-48f6-9f6e-e72cca3529ee" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b76af-f551-4fa3-b7a2-9bdeeba41d83]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:49 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee Sep 28 05:19:49 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:50 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee" returned: 0 in 0.568s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:50 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee Sep 28 05:19:50 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:50 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4e302f54-db3e-48f6-9f6e-e72cca3529ee" returned: 0 in 0.317s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-4e302f54-db3e-48f6-9f6e-e72cca3529ee" released by "delete_volume" :: held 0.948s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['65554ea8-946e-4c2c-90a3-3d468d3fc7af', 'fc529aab-be13-4f47-9c6a-c56583c8ba15', '0a5d7ff1-aa1d-439a-a2dd-b02073e1267a', 'a0e29bca-19c2-4c2a-b96e-de379c51c96d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:50 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:50 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:51 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.304s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3b442d75-322e-4b09-855b-746ab6c0009b req-dd81c2ea-28c7-40f3-9216-9a0d51251972 tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3b442d75-322e-4b09-855b-746ab6c0009b req-dd81c2ea-28c7-40f3-9216-9a0d51251972 tempest-TestStampPattern-643231710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-3b442d75-322e-4b09-855b-746ab6c0009b req-dd81c2ea-28c7-40f3-9216-9a0d51251972 tempest-TestStampPattern-643231710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1dbaad5e-868e-4778-a2ec-63ccf80118b1 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-4e302f54-db3e-48f6-9f6e-e72cca3529ee-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-3b442d75-322e-4b09-855b-746ab6c0009b req-dd81c2ea-28c7-40f3-9216-9a0d51251972 tempest-TestStampPattern-643231710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-4860ccf6-3657-41a6-96a7-05ae2e378a60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2971e72f-b66e-4d7f-9c38-6cf3da4a29fe', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:19:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-3b442d75-322e-4b09-855b-746ab6c0009b req-dd81c2ea-28c7-40f3-9216-9a0d51251972 tempest-TestStampPattern-643231710 None] attachment_update completed successfully. Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Acquiring lock "cinder-22fe5ad8-bfec-4028-8553-f4aa9c22c121-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "cinder-22fe5ad8-bfec-4028-8553-f4aa9c22c121-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Acquiring lock "cinder-quobyte-22fe5ad8-bfec-4028-8553-f4aa9c22c121" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "cinder-quobyte-22fe5ad8-bfec-4028-8553-f4aa9c22c121" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7122a290-4845-486f-95ea-c3afd6bacf15]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:51 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 Sep 28 05:19:51 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:51 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121" returned: 0 in 0.426s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:51 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121 Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-4157394c-019d-49e0-9fee-a5027b006848-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:51 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-4157394c-019d-49e0-9fee-a5027b006848-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-4157394c-019d-49e0-9fee-a5027b006848" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-4157394c-019d-49e0-9fee-a5027b006848" acquired by "delete_volume" :: waited 0.040s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[148bed8c-3ff6-4c97-9f1c-bd2e4f137317]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:52 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22fe5ad8-bfec-4028-8553-f4aa9c22c121" returned: 0 in 0.337s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "cinder-quobyte-22fe5ad8-bfec-4028-8553-f4aa9c22c121" released by "delete_volume" :: held 0.815s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Created reservations ['791aef49-60ff-4839-a1e8-c692b937a3ef', '9c48178f-3ef8-4ab2-92a9-3d46b1e0dd28', '5042b5a0-eda2-4d65-a969-d0f52732b52e', '5f4e5533-b7a7-477f-acb2-9e69bcd7a556'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:52 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 Sep 28 05:19:52 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:52 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:52 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:52 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848" returned: 0 in 0.492s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:52 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.314s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:52 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848 Sep 28 05:19:52 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Deleted volume successfully. Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-88229add-9026-44f7-88ee-e14cd19e4e25 tempest-VolumesNegativeTest-64322066 None] Lock "cinder-22fe5ad8-bfec-4028-8553-f4aa9c22c121-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:52 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4157394c-019d-49e0-9fee-a5027b006848" returned: 0 in 0.298s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-4157394c-019d-49e0-9fee-a5027b006848" released by "delete_volume" :: held 0.867s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:52 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['df944ff3-5982-42a1-b4a4-0d6115699f3f', 'df944e67-30db-49c4-8388-f034c0afb22a', 'd8b68148-53a6-4d1e-bade-560ac87fc742', '611bd470-2fcd-41c6-84a2-ba7818c6e2d6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:53 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:53 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:53 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:53 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:53 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7dc677ff-d080-4f8d-8e35-b5761bc24a18 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-4157394c-019d-49e0-9fee-a5027b006848-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-fc552dd9-09c9-4150-8312-ef40967be41f-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-fc552dd9-09c9-4150-8312-ef40967be41f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-fc552dd9-09c9-4150-8312-ef40967be41f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-fc552dd9-09c9-4150-8312-ef40967be41f" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c4ec43-274c-42b8-b566-d3e1aed8781d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:54 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f Sep 28 05:19:54 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:54 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f" returned: 0 in 0.388s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:54 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f Sep 28 05:19:54 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:54 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-959fea98-064e-4f6f-bfe5-64cb64619462 req-bd0a82e0-0a0f-456a-a83c-d6340f3cb4ad tempest-TestStampPattern-643231710 None] Terminate volume connection completed successfully. Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-959fea98-064e-4f6f-bfe5-64cb64619462 req-bd0a82e0-0a0f-456a-a83c-d6340f3cb4ad tempest-TestStampPattern-643231710 None] Deleting attachment 2971e72f-b66e-4d7f-9c38-6cf3da4a29fe. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:19:54 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc552dd9-09c9-4150-8312-ef40967be41f" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:54 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-fc552dd9-09c9-4150-8312-ef40967be41f" released by "delete_volume" :: held 0.781s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['e40a2ca0-ab70-4b21-a783-3674b3a7fec0', '627487fb-d595-4561-a948-24bcc8fe3eda', '7740ae0b-f3ae-470a-a013-80fde591979a', '766e33d5-839e-4ff1-9238-f65744d67d82'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:55 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:55 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-0cd9e83f-010f-4966-9c11-e9846585c32d-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-0cd9e83f-010f-4966-9c11-e9846585c32d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "cinder-quobyte-0cd9e83f-010f-4966-9c11-e9846585c32d" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-0cd9e83f-010f-4966-9c11-e9846585c32d" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:19:55 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fbb13e-1cdb-498a-830f-75b3664b2701]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-eac14478-82d6-438d-a07c-af7ef16c8db7 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-fc552dd9-09c9-4150-8312-ef40967be41f-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:55 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d Sep 28 05:19:55 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:55 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d" returned: 0 in 0.434s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:55 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d Sep 28 05:19:55 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:56 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0cd9e83f-010f-4966-9c11-e9846585c32d" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-quobyte-0cd9e83f-010f-4966-9c11-e9846585c32d" released by "delete_volume" :: held 0.817s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Created reservations ['53b84786-e997-4ffa-adc8-c7ece8de8bb0', 'dfce3262-afbb-4fae-84f0-91687e0dddde', 'f18ce710-407a-4eea-b697-b5563a63e554', 'cf230b05-31aa-485a-9036-f0aac2002504'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:19:56 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:19:56 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:19:56 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.454s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:19:56 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:19:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Deleted volume successfully. Sep 28 05:19:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cde98392-5c53-4d45-9d19-7c38e6938774 tempest-CreateVolumesFromSourceVolumeTest-1284431489 None] Lock "cinder-0cd9e83f-010f-4966-9c11-e9846585c32d-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-4860ccf6-3657-41a6-96a7-05ae2e378a60-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "cinder-4860ccf6-3657-41a6-96a7-05ae2e378a60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347e6a3-1792-446d-bd19-a168a4731373]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:00 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 Sep 28 05:20:00 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:00 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60" returned: 0 in 0.387s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:00 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60 Sep 28 05:20:00 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:00 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4860ccf6-3657-41a6-96a7-05ae2e378a60" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-4860ccf6-3657-41a6-96a7-05ae2e378a60" released by "delete_volume" :: held 0.689s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Created reservations ['137c5797-c21f-4aa5-9e0a-ebd23f5716be', 'cdb0a0ee-f3d9-4aaa-ba3b-5418bf107f9e', '5a226a44-b92e-4422-a80d-da2f2dd55f4d', '3fa5226a-2b4b-4b12-9a97-a05fde3d8b5e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:00 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:00 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:01 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.309s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Deleted volume successfully. Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-889a0f01-41da-4e19-ab03-c1736c67580b tempest-TestStampPattern-643231710 None] Lock "cinder-4860ccf6-3657-41a6-96a7-05ae2e378a60-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-90b19385-08c6-40b5-9bc8-d8ee1524c12a-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-90b19385-08c6-40b5-9bc8-d8ee1524c12a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Deleting offline snapshot 90b19385-08c6-40b5-9bc8-d8ee1524c12a of volume 86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] snapshot_file for this snap is: volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8e7eac-c338-4514-8167-4d031aa91595]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:01 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:20:01 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:02 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.413s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fecbb-feee-4d6f-b4f6-09c540ec292c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:02 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:20:02 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:02 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.577s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:02 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:20:02 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:03 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.367s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:03 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a Sep 28 05:20:03 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:03 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf.90b19385-08c6-40b5-9bc8-d8ee1524c12a" returned: 0 in 0.273s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-90b19385-08c6-40b5-9bc8-d8ee1524c12a" released by "_delete_snapshot" :: held 1.778s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" released by "delete_snapshot" :: held 1.803s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Created reservations ['bc6ad93b-f80e-47fc-b7c4-71fc4cde8e5b', '04bdeaa2-dcfc-4bb6-bcff-bf029a6dd5c0', '94857daa-ca19-4faa-bf1f-2fc432c39979', '8c0e077f-82f5-4b2e-93d8-211e48782e61'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Delete snapshot completed successfully. Sep 28 05:20:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-640a1b45-61e7-455c-8673-7ac5edb14119 tempest-TestStampPattern-643231710 None] Lock "cinder-90b19385-08c6-40b5-9bc8-d8ee1524c12a-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-86ef1a1b-97ec-4653-81b5-375b37eed2cf-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "cinder-86ef1a1b-97ec-4653-81b5-375b37eed2cf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Acquiring lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9edb511-1c9e-464c-b993-70193bfc8dca]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:08 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:20:08 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:08 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.399s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:08 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf Sep 28 05:20:08 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:08 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-86ef1a1b-97ec-4653-81b5-375b37eed2cf" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "cinder-quobyte-86ef1a1b-97ec-4653-81b5-375b37eed2cf" released by "delete_volume" :: held 0.790s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Created reservations ['1c78203e-0c3d-4fba-8e97-10729a738596', '0de948d0-c8d9-40e0-8e79-8d973f401ada', '17c0b5bd-9b2e-4da4-9ff2-d74302abddc2', 'c58025c3-2bef-4c98-b48c-9500ffe8df53'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:09 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:09 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:09 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:09 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Deleted volume successfully. Sep 28 05:20:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4523dcf4-10fa-492a-8c16-d318dedc33a4 tempest-TestStampPattern-643231710 None] Lock "cinder-86ef1a1b-97ec-4653-81b5-375b37eed2cf-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:18 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=66,cinder:UPDATE=101,cinder:DELETE=6,cinder:INSERT=21 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=73,cinder:INSERT=25,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Flow 'volume_create_manager' (5cca81e8-937f-4bfd-872b-cd0dc2946be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0073ec8f-d4d3-42d7-9483-eff6f6b0736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0073ec8f-d4d3-42d7-9483-eff6f6b0736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-499139262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d61a1-f9e0-4218-b385-9b3dd549f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac50bccdde0436383a10fd28790615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:19Z,use_quota=True,user_id='8eda9f90ec59453581df72484ee67f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b044aa-da3b-4e3c-97b3-f26c85134e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b044aa-da3b-4e3c-97b3-f26c85134e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ded9dc-26c6-419a-8e4e-81e117b20589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ded9dc-26c6-419a-8e4e-81e117b20589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2d61a1-f9e0-4218-b385-9b3dd549f580', 'volume_name': 'volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6febe769-c443-43fa-a147-dd178f6bbd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6febe769-c443-43fa-a147-dd178f6bbd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f679cd-c11b-4506-ae29-8c789201a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume 8b2d61a1-f9e0-4218-b385-9b3dd549f580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580', 'volume_size': 1} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-499139262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d61a1-f9e0-4218-b385-9b3dd549f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac50bccdde0436383a10fd28790615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:19Z,use_quota=True,user_id='8eda9f90ec59453581df72484ee67f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Creating volume 8b2d61a1-f9e0-4218-b385-9b3dd549f580 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:19 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:19 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 1073741824 Sep 28 05:20:19 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Flow 'volume_create_manager' (5dfb917a-e002-406a-992a-908890b608e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b073aa2a-07d1-4ca4-b74f-dd6716430b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b073aa2a-07d1-4ca4-b74f-dd6716430b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1547252195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2629e6-38bd-46bb-8e43-e125a67177af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac50bccdde0436383a10fd28790615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:20Z,use_quota=True,user_id='8eda9f90ec59453581df72484ee67f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68220ee4-4f6f-4638-8eaf-4eb6a783ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68220ee4-4f6f-4638-8eaf-4eb6a783ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e570919-6e65-4ee1-a7d7-3d2da0d6835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e570919-6e65-4ee1-a7d7-3d2da0d6835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2629e6-38bd-46bb-8e43-e125a67177af', 'volume_name': 'volume-6d2629e6-38bd-46bb-8e43-e125a67177af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c07b69b-832b-4381-8d0d-7de6e96df82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c07b69b-832b-4381-8d0d-7de6e96df82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79fa087-73d3-4ad3-afc4-952cd02a8877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume 6d2629e6-38bd-46bb-8e43-e125a67177af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2629e6-38bd-46bb-8e43-e125a67177af', 'volume_size': 1} Sep 28 05:20:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:20 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 1073741824" returned: 0 in 0.585s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:20 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 Sep 28 05:20:20 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:20 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580" returned: 0 in 0.268s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1547252195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2629e6-38bd-46bb-8e43-e125a67177af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac50bccdde0436383a10fd28790615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:20Z,use_quota=True,user_id='8eda9f90ec59453581df72484ee67f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Creating volume 6d2629e6-38bd-46bb-8e43-e125a67177af {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:20 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f679cd-c11b-4506-ae29-8c789201a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:20 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af 1073741824 Sep 28 05:20:20 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181d184f-0434-43f0-bd19-8b18f868c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 (8b2d61a1-f9e0-4218-b385-9b3dd549f580): created successfully Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181d184f-0434-43f0-bd19-8b18f868c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Flow 'volume_create_manager' (5cca81e8-937f-4bfd-872b-cd0dc2946be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4f4f47a4-ddd2-4ff6-b063-8dcc42ac27e6 tempest-TestServerVolumeAttachmentScenario-126460277 None] Created volume successfully. Sep 28 05:20:20 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af 1073741824" returned: 0 in 0.574s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:21 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af Sep 28 05:20:21 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:21 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79fa087-73d3-4ad3-afc4-952cd02a8877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2629e6-38bd-46bb-8e43-e125a67177af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ddd5e7-0f36-4eb8-9942-15f011609bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Volume volume-6d2629e6-38bd-46bb-8e43-e125a67177af (6d2629e6-38bd-46bb-8e43-e125a67177af): created successfully Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ddd5e7-0f36-4eb8-9942-15f011609bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Flow 'volume_create_manager' (5dfb917a-e002-406a-992a-908890b608e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-366c78c3-1b91-4cec-9368-d59380cc0723 tempest-TestServerVolumeAttachmentScenario-126460277 None] Created volume successfully. Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Flow 'volume_create_manager' (bc1ec996-547f-43a5-aa64-068333e1f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501342ad-8b01-4289-b7e7-48be8037fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501342ad-8b01-4289-b7e7-48be8037fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd48740-e967-401f-9b09-7ecb45987b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793590193a2c43c9b13be98e422575bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:26Z,use_quota=True,user_id='fac1bb56f71046cead4ac76c8b914cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2c0a07b-878d-42a1-90cc-728e380353e1),volume_type_id=b2c0a07b-878d-42a1-90cc-728e380353e1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc2261f-49cb-4080-ad6c-89e26796a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc2261f-49cb-4080-ad6c-89e26796a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb0fe11-ff04-4061-b8ef-00dcc0c4b0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb0fe11-ff04-4061-b8ef-00dcc0c4b0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bfd48740-e967-401f-9b09-7ecb45987b5a', 'volume_name': 'volume-bfd48740-e967-401f-9b09-7ecb45987b5a', 'volume_size': 1, 'image_id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5743ff216826ce6287600a5c96d0bf8a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '793590193a2c43c9b13be98e422575bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '954494a2586d04ba91ce93951b22391d44f375ed9ba51b1fa4b0405b164827fbc883f24ebd7c32c530a5aabfa42b5a36e8d3b1188a250c831d1af6bc31359143', 'id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f44766a-96c7-4903-86fc-04789fa6ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f44766a-96c7-4903-86fc-04789fa6ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5316bf78-8177-48ab-b316-4f9389d369b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:26 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Volume bfd48740-e967-401f-9b09-7ecb45987b5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bfd48740-e967-401f-9b09-7ecb45987b5a', 'volume_size': 1, 'image_id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5743ff216826ce6287600a5c96d0bf8a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '793590193a2c43c9b13be98e422575bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '954494a2586d04ba91ce93951b22391d44f375ed9ba51b1fa4b0405b164827fbc883f24ebd7c32c530a5aabfa42b5a36e8d3b1188a250c831d1af6bc31359143', 'id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Trying to clone bfd48740-e967-401f-9b09-7ecb45987b5a from image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:20:26 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Image download 0.00 MB at 0.00 MB/s Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12bd3c-a9ba-429b-b394-8f93b71ede60]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:27 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:27 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:27 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:27 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:27 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:27 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Temporary image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 is fetched for user fac1bb56f71046cead4ac76c8b914cfd. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7cedd2-94aa-42e6-a3cf-cc24141c9236]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:27 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:27 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:28 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:28 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:28 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:28 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd48740-e967-401f-9b09-7ecb45987b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793590193a2c43c9b13be98e422575bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:26Z,use_quota=True,user_id='fac1bb56f71046cead4ac76c8b914cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2c0a07b-878d-42a1-90cc-728e380353e1),volume_type_id=b2c0a07b-878d-42a1-90cc-728e380353e1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Creating volume bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:28 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:28 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1073741824 Sep 28 05:20:28 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:28 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1073741824" returned: 0 in 0.580s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:29 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a Sep 28 05:20:29 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:29 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a" returned: 0 in 0.252s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Attempting download of 8ad67ae3-270c-4c1e-84fe-6a26ab170224 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}])) to volume bfd48740-e967-401f-9b09-7ecb45987b5a. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8e2e42-681c-4694-a536-e859d6467edd]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:29 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:29 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:29 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2 Sep 28 05:20:29 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:29 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:20:29 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2" returned: 0 in 0.344s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:29 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2 Sep 28 05:20:29 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:30 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2" returned: 1 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad67ae3-270c-4c1e-84fe-6a26ab170224_lls0acj2' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef5e30-b436-448b-9df2-42ab17efe467]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:30 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:30 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:30 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:30 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD Sep 28 05:20:30 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:30 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] 8ad67ae3-270c-4c1e-84fe-6a26ab170224 was raw, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:20:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:30 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a Sep 28 05:20:30 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:31 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a" returned: 0 in 0.560s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ad67ae3-270c-4c1e-84fe-6a26ab170224_dfuhorufdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:20:31 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:31 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1G Sep 28 05:20:31 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:31 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a 1G" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Downloaded image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}])) to volume bfd48740-e967-401f-9b09-7ecb45987b5a successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Temporary image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 for user fac1bb56f71046cead4ac76c8b914cfd is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Marking volume bfd48740-e967-401f-9b09-7ecb45987b5a as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Copying metadata from image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 to bfd48740-e967-401f-9b09-7ecb45987b5a. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Creating volume glance metadata for volume bfd48740-e967-401f-9b09-7ecb45987b5a backed by image 8ad67ae3-270c-4c1e-84fe-6a26ab170224 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5743ff216826ce6287600a5c96d0bf8a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5316bf78-8177-48ab-b316-4f9389d369b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd48740-e967-401f-9b09-7ecb45987b5a', 'volume_size': 1, 'image_id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5743ff216826ce6287600a5c96d0bf8a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '793590193a2c43c9b13be98e422575bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '954494a2586d04ba91ce93951b22391d44f375ed9ba51b1fa4b0405b164827fbc883f24ebd7c32c530a5aabfa42b5a36e8d3b1188a250c831d1af6bc31359143', 'id': '8ad67ae3-270c-4c1e-84fe-6a26ab170224', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad67ae3-270c-4c1e-84fe-6a26ab170224/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56809d-f65f-448a-9996-8faddbc43c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:31 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Volume volume-bfd48740-e967-401f-9b09-7ecb45987b5a (bfd48740-e967-401f-9b09-7ecb45987b5a): created successfully Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56809d-f65f-448a-9996-8faddbc43c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Flow 'volume_create_manager' (bc1ec996-547f-43a5-aa64-068333e1f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-45b31f05-c59d-4eb1-bcf3-8ed8c970057b tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Created volume successfully. Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Acquiring lock "cinder-bfd48740-e967-401f-9b09-7ecb45987b5a-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "cinder-bfd48740-e967-401f-9b09-7ecb45987b5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Acquiring lock "cinder-quobyte-bfd48740-e967-401f-9b09-7ecb45987b5a" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "cinder-quobyte-bfd48740-e967-401f-9b09-7ecb45987b5a" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895d6c1-2db8-4e44-bed9-99f5ad5f51a2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:32 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a Sep 28 05:20:32 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:32 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:32 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a Sep 28 05:20:32 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:33 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-bfd48740-e967-401f-9b09-7ecb45987b5a" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "cinder-quobyte-bfd48740-e967-401f-9b09-7ecb45987b5a" released by "delete_volume" :: held 0.681s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:33 devstack cinder-volume[86815]: WARNING cinder.quota [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:20:33 devstack cinder-volume[86815]: WARNING cinder.quota [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Created reservations ['88302f1d-c2ff-4928-a513-851ecb14f1cb', '6a308449-8c1d-4360-8a2e-c56bcafa4605', '08d07538-779d-41ed-8db9-b4ad38ddd9ac', 'b91d2a12-2bc4-4263-a0d0-7078d4f9a3f6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:33 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:33 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:33 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Deleted volume successfully. Sep 28 05:20:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-baeb19c5-76cb-4f6f-8d3e-418eb91a99de tempest-VolumeAndVolumeTypeFromImageTest-399927625 None] Lock "cinder-bfd48740-e967-401f-9b09-7ecb45987b5a-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Flow 'volume_create_manager' (9250074a-2942-4c67-b98d-07893c8cc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d8ca15-9258-4bbe-9328-30e68803baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d8ca15-9258-4bbe-9328-30e68803baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27391240-4bbb-42bc-a217-17991d4400cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80db9856ea994fad9c095e5ad44a8f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:40Z,use_quota=True,user_id='27644a559adf402190dcc47a4d8f53d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b694d50c-9baf-4c91-a29b-a173e650dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b694d50c-9baf-4c91-a29b-a173e650dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327e07f4-a738-4239-a037-f83b162d5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327e07f4-a738-4239-a037-f83b162d5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27391240-4bbb-42bc-a217-17991d4400cb', 'volume_name': 'volume-27391240-4bbb-42bc-a217-17991d4400cb', 'volume_size': 1, 'image_id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e2bc057db579e14e3d0fc54c68891b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80db9856ea994fad9c095e5ad44a8f1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '288d27e93c872a70fd71e1caf161e6715bfd7d3a1886d6da7d4774ecf72f76d5bd2ced935708f69c36d7a7b0b1274b2d2948d863eea8da485e6ece5fa60b4007', 'id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11f36c4-7f6c-490e-bbff-54782de26fa4/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb20722-9a27-422f-a023-780290861c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb20722-9a27-422f-a023-780290861c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0833c45-4f08-4d2c-b832-66bcb74f3d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:40 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Volume 27391240-4bbb-42bc-a217-17991d4400cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27391240-4bbb-42bc-a217-17991d4400cb', 'volume_size': 1, 'image_id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e2bc057db579e14e3d0fc54c68891b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80db9856ea994fad9c095e5ad44a8f1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '288d27e93c872a70fd71e1caf161e6715bfd7d3a1886d6da7d4774ecf72f76d5bd2ced935708f69c36d7a7b0b1274b2d2948d863eea8da485e6ece5fa60b4007', 'id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11f36c4-7f6c-490e-bbff-54782de26fa4/file', 'properties': {}}, 'image_service': } Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Trying to clone 27391240-4bbb-42bc-a217-17991d4400cb from image c11f36c4-7f6c-490e-bbff-54782de26fa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:20:40 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Image download 0.00 MB at 0.00 MB/s Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae29e7-ec72-4465-8c88-4e664f02ba5c]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:40 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:40 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:40 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:41 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:41 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:41 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Temporary image c11f36c4-7f6c-490e-bbff-54782de26fa4 is fetched for user 27644a559adf402190dcc47a4d8f53d4. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[340890ab-9ba7-4a8e-b038-13dbc52cb740]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:41 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:41 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:41 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:41 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:41 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:42 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27391240-4bbb-42bc-a217-17991d4400cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80db9856ea994fad9c095e5ad44a8f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:40Z,use_quota=True,user_id='27644a559adf402190dcc47a4d8f53d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Creating volume 27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:42 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:42 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1073741824 Sep 28 05:20:42 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:42 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1073741824" returned: 0 in 0.412s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:42 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb Sep 28 05:20:42 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:42 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Attempting download of c11f36c4-7f6c-490e-bbff-54782de26fa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}])) to volume 27391240-4bbb-42bc-a217-17991d4400cb. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f4b9c-f1c4-47da-afdd-0db292e4a3e7]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:42 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj Sep 28 05:20:42 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:43 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:43 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj Sep 28 05:20:43 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:43 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj" returned: 1 in 0.322s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11f36c4-7f6c-490e-bbff-54782de26fa4_cg5izyfj' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a7ab0-c1af-422f-877d-9616e13b1ea2]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:43 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:43 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:43 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:43 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD Sep 28 05:20:43 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:44 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] c11f36c4-7f6c-490e-bbff-54782de26fa4 was raw, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:44 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb Sep 28 05:20:44 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:44 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb" returned: 0 in 0.449s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c11f36c4-7f6c-490e-bbff-54782de26fa4_r05he9kgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:20:44 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:44 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1G Sep 28 05:20:44 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:44 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb 1G" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Downloaded image c11f36c4-7f6c-490e-bbff-54782de26fa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}])) to volume 27391240-4bbb-42bc-a217-17991d4400cb successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Temporary image c11f36c4-7f6c-490e-bbff-54782de26fa4 for user 27644a559adf402190dcc47a4d8f53d4 is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Marking volume 27391240-4bbb-42bc-a217-17991d4400cb as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Copying metadata from image c11f36c4-7f6c-490e-bbff-54782de26fa4 to 27391240-4bbb-42bc-a217-17991d4400cb. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Creating volume glance metadata for volume 27391240-4bbb-42bc-a217-17991d4400cb backed by image c11f36c4-7f6c-490e-bbff-54782de26fa4 with: {'image_id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1e2bc057db579e14e3d0fc54c68891b1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0833c45-4f08-4d2c-b832-66bcb74f3d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27391240-4bbb-42bc-a217-17991d4400cb', 'volume_size': 1, 'image_id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11f36c4-7f6c-490e-bbff-54782de26fa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e2bc057db579e14e3d0fc54c68891b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80db9856ea994fad9c095e5ad44a8f1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '288d27e93c872a70fd71e1caf161e6715bfd7d3a1886d6da7d4774ecf72f76d5bd2ced935708f69c36d7a7b0b1274b2d2948d863eea8da485e6ece5fa60b4007', 'id': 'c11f36c4-7f6c-490e-bbff-54782de26fa4', 'created_at': datetime.datetime(2026, 9, 28, 3, 20, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11f36c4-7f6c-490e-bbff-54782de26fa4/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c148e13-c7af-4599-b66b-683c6f38921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Volume volume-27391240-4bbb-42bc-a217-17991d4400cb (27391240-4bbb-42bc-a217-17991d4400cb): created successfully Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c148e13-c7af-4599-b66b-683c6f38921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Flow 'volume_create_manager' (9250074a-2942-4c67-b98d-07893c8cc555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9831b749-22b9-4fe8-ad70-5797500e1c0e tempest-VolumeImageDependencyTests-1941047130 None] Created volume successfully. Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Acquiring lock "cinder-27391240-4bbb-42bc-a217-17991d4400cb-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "cinder-27391240-4bbb-42bc-a217-17991d4400cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Acquiring lock "cinder-quobyte-27391240-4bbb-42bc-a217-17991d4400cb" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "cinder-quobyte-27391240-4bbb-42bc-a217-17991d4400cb" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c270566-b365-4ece-a1e8-644842a2c9d1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:45 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb Sep 28 05:20:45 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:45 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb" returned: 0 in 0.359s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:45 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb Sep 28 05:20:45 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:46 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-27391240-4bbb-42bc-a217-17991d4400cb" returned: 0 in 0.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "cinder-quobyte-27391240-4bbb-42bc-a217-17991d4400cb" released by "delete_volume" :: held 0.646s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Created reservations ['a732dbdf-2ea6-44d7-b776-bef4d19904a5', 'b7e71861-be05-463d-a930-5acf9a3c7524', 'c415b0f2-648b-4a44-bf80-f5563bbdcaa6', 'ac71463b-ea4c-4742-a5a7-2eaa1933a05d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:46 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:46 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:46 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.257s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Deleted volume successfully. Sep 28 05:20:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c7e95128-0ef9-44a5-90f6-bc60a2d10b74 tempest-VolumeImageDependencyTests-1941047130 None] Lock "cinder-27391240-4bbb-42bc-a217-17991d4400cb-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Flow 'volume_create_manager' (f55909a3-aaa6-457b-b43c-275dc2cd2099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487c5cb-3a0e-46c1-9cb2-525291d53ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487c5cb-3a0e-46c1-9cb2-525291d53ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d8142d-6b44-427a-bfe4-77ed64f2ea04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0043b4a0c64ae2a3c6d99ca67b3e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:50Z,use_quota=True,user_id='c169db026b604f6f986355358b4edaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125700bd-c4e1-4f22-ab0d-1bb6f9d8f562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125700bd-c4e1-4f22-ab0d-1bb6f9d8f562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437682bd-906c-41a5-9274-c99dabce8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437682bd-906c-41a5-9274-c99dabce8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d8142d-6b44-427a-bfe4-77ed64f2ea04', 'volume_name': 'volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4280b66f-ff26-4343-9fb3-f4985873ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4280b66f-ff26-4343-9fb3-f4985873ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3275310-4413-4847-8eed-893fa593f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:49 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Volume 39d8142d-6b44-427a-bfe4-77ed64f2ea04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04', 'volume_size': 1} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d8142d-6b44-427a-bfe4-77ed64f2ea04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0043b4a0c64ae2a3c6d99ca67b3e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:50Z,use_quota=True,user_id='c169db026b604f6f986355358b4edaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Creating volume 39d8142d-6b44-427a-bfe4-77ed64f2ea04 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:49 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:49 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 1073741824 Sep 28 05:20:49 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:50 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 1073741824" returned: 0 in 0.418s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:50 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 Sep 28 05:20:50 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:50 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3275310-4413-4847-8eed-893fa593f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef5d0b8-766a-42c9-8875-0c3aa247a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:50 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Volume volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 (39d8142d-6b44-427a-bfe4-77ed64f2ea04): created successfully Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef5d0b8-766a-42c9-8875-0c3aa247a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Flow 'volume_create_manager' (f55909a3-aaa6-457b-b43c-275dc2cd2099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2d6d69be-4475-4e86-985e-0a6ec349f292 tempest-CinderUnicodeTest-2107988774 None] Created volume successfully. Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Flow 'volume_create_manager' (f4b47f50-dda4-4bfa-ae88-a4c4f5a54cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c804d6-8f50-4472-b09c-4c9680af5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c804d6-8f50-4472-b09c-4c9680af5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261558568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca0507-0e88-41a7-a483-bf55204d1cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0043b4a0c64ae2a3c6d99ca67b3e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:51Z,use_quota=True,user_id='c169db026b604f6f986355358b4edaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5d16a0-f7b9-460c-9554-0296e1f021b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5d16a0-f7b9-460c-9554-0296e1f021b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a68ec7-bc40-405a-a08a-06f3e17a1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a68ec7-bc40-405a-a08a-06f3e17a1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ca0507-0e88-41a7-a483-bf55204d1cf0', 'volume_name': 'volume-22ca0507-0e88-41a7-a483-bf55204d1cf0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109dc067-ff96-408e-b39e-7c58d074c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109dc067-ff96-408e-b39e-7c58d074c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9e4210-2179-4b69-a55d-5feb36e7d624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Volume 22ca0507-0e88-41a7-a483-bf55204d1cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ca0507-0e88-41a7-a483-bf55204d1cf0', 'volume_size': 1} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:20:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261558568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ca0507-0e88-41a7-a483-bf55204d1cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0043b4a0c64ae2a3c6d99ca67b3e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:20:51Z,use_quota=True,user_id='c169db026b604f6f986355358b4edaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Creating volume 22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:20:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:51 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 1073741824 Sep 28 05:20:51 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:51 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 1073741824" returned: 0 in 0.451s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:51 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 Sep 28 05:20:51 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:51 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0" returned: 0 in 0.257s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9e4210-2179-4b69-a55d-5feb36e7d624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ca0507-0e88-41a7-a483-bf55204d1cf0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed80bb6-10b0-4b27-96e4-c98f939deec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:20:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Volume volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 (22ca0507-0e88-41a7-a483-bf55204d1cf0): created successfully Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed80bb6-10b0-4b27-96e4-c98f939deec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:20:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Flow 'volume_create_manager' (f4b47f50-dda4-4bfa-ae88-a4c4f5a54cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:20:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-148f63e6-5ad5-48b3-a880-e5bf71ed0a91 tempest-CinderUnicodeTest-2107988774 None] Created volume successfully. Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Creating offline snapshot 486bc8c1-3b6b-4423-9469-697ed5b95236 of volume 22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b578e7-5d08-4936-858a-c03ccd510898]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:52 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 Sep 28 05:20:52 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fbf2541a-9d18-4d6d-8551-c243c4a3c4a3 req-1f372056-0bd9-4250-ba8c-fe1e2f317ac0 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:52 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0" returned: 0 in 0.412s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:52 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 1G Sep 28 05:20:52 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:53 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 1G" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:53 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 Sep 28 05:20:53 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:53 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:53 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 is being set with open permissions: ugo+rw Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:53 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 Sep 28 05:20:53 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:53 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236" returned: 0 in 0.252s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:53 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info Sep 28 05:20:53 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:54 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:54 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info is being set with open permissions: ugo+rw Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:54 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info Sep 28 05:20:54 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:54 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.info" returned: 0 in 0.239s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fbf2541a-9d18-4d6d-8551-c243c4a3c4a3 req-1f372056-0bd9-4250-ba8c-fe1e2f317ac0 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.815s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-fbf2541a-9d18-4d6d-8551-c243c4a3c4a3 req-1f372056-0bd9-4250-ba8c-fe1e2f317ac0 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:54 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-98b3a7df-c838-4620-9175-e7a2f4db338d tempest-CinderUnicodeTest-2107988774 None] Create snapshot completed successfully Sep 28 05:20:54 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-fbf2541a-9d18-4d6d-8551-c243c4a3c4a3 req-1f372056-0bd9-4250-ba8c-fe1e2f317ac0 tempest-TestServerVolumeAttachmentScenario-126460277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38f0f611-74d5-4948-b0e8-4f6133b79d9f', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:20:54 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-fbf2541a-9d18-4d6d-8551-c243c4a3c4a3 req-1f372056-0bd9-4250-ba8c-fe1e2f317ac0 tempest-TestServerVolumeAttachmentScenario-126460277 None] attachment_update completed successfully. Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-486bc8c1-3b6b-4423-9469-697ed5b95236-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-486bc8c1-3b6b-4423-9469-697ed5b95236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-quobyte-486bc8c1-3b6b-4423-9469-697ed5b95236" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-486bc8c1-3b6b-4423-9469-697ed5b95236" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Deleting offline snapshot 486bc8c1-3b6b-4423-9469-697ed5b95236 of volume 22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] snapshot_file for this snap is: volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[882afc55-0ff3-47e3-8184-8f05b4da0d45]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:55 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 Sep 28 05:20:55 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:55 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ca0507-0e88-41a7-a483-bf55204d1cf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab652a-2848-4893-9bb1-6580e6c4fb5e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:56 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 Sep 28 05:20:56 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:56 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0" returned: 0 in 0.386s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:56 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 Sep 28 05:20:56 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:56 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236" returned: 0 in 0.367s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:56 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236 Sep 28 05:20:56 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:57 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0.486bc8c1-3b6b-4423-9469-697ed5b95236" returned: 0 in 0.265s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-486bc8c1-3b6b-4423-9469-697ed5b95236" released by "_delete_snapshot" :: held 1.507s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" released by "delete_snapshot" :: held 1.528s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Created reservations ['bd34746e-693c-4054-a3a5-d4aa88c91b77', 'a797bd6f-0546-4570-b7fc-64cd4ddda5d4', '1166ffac-7914-4422-a516-e6d194019fe4', '1957bda6-3504-4d05-a6bc-d611d92bab39'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Delete snapshot completed successfully. Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0b4e32ac-8bcb-4dcb-be14-9adb8858c299 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-486bc8c1-3b6b-4423-9469-697ed5b95236-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-22ca0507-0e88-41a7-a483-bf55204d1cf0-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-22ca0507-0e88-41a7-a483-bf55204d1cf0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d420c5a-f704-4308-812a-7460405e4fe1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:58 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 Sep 28 05:20:58 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-e9e0012f-a396-47ae-8026-24e7aa7e15e9 req-c867209f-858e-4d84-a61a-5922207eacbf tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-e9e0012f-a396-47ae-8026-24e7aa7e15e9 req-c867209f-858e-4d84-a61a-5922207eacbf tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [req-e9e0012f-a396-47ae-8026-24e7aa7e15e9 req-c867209f-858e-4d84-a61a-5922207eacbf tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-e9e0012f-a396-47ae-8026-24e7aa7e15e9 req-c867209f-858e-4d84-a61a-5922207eacbf tempest-TestServerVolumeAttachmentScenario-126460277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46', 'name': 'volume-6d2629e6-38bd-46bb-8e43-e125a67177af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ca4c61-519b-4693-bb79-081cd82a6e02', 'enforce_multipath': True} {{(pid=86815) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 05:20:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-e9e0012f-a396-47ae-8026-24e7aa7e15e9 req-c867209f-858e-4d84-a61a-5922207eacbf tempest-TestServerVolumeAttachmentScenario-126460277 None] attachment_update completed successfully. Sep 28 05:20:58 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0" returned: 0 in 0.391s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:58 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0 Sep 28 05:20:58 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:58 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-22ca0507-0e88-41a7-a483-bf55204d1cf0" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-22ca0507-0e88-41a7-a483-bf55204d1cf0" released by "delete_volume" :: held 0.745s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Created reservations ['e7be5734-f70d-48e2-83c2-f9c99784fc43', 'c5633956-5897-4d3d-87df-1ea8f2edd396', 'b4644594-b222-47fd-8bed-a38ef23b21e4', 'd09708a7-37b5-4959-930a-b34c63415418'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:58 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:58 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-39d8142d-6b44-427a-bfe4-77ed64f2ea04-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-39d8142d-6b44-427a-bfe4-77ed64f2ea04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "cinder-quobyte-39d8142d-6b44-427a-bfe4-77ed64f2ea04" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-39d8142d-6b44-427a-bfe4-77ed64f2ea04" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:20:59 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:20:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Deleted volume successfully. Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bdbb1f-bce6-4681-b8ff-98e0061ba8a8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2703beba-5ebc-4bb4-912f-68c641fb6ff8 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-22ca0507-0e88-41a7-a483-bf55204d1cf0-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:59 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 Sep 28 05:20:59 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:59 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04" returned: 0 in 0.383s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:59 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04 Sep 28 05:20:59 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:59 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-39d8142d-6b44-427a-bfe4-77ed64f2ea04" returned: 0 in 0.265s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-quobyte-39d8142d-6b44-427a-bfe4-77ed64f2ea04" released by "delete_volume" :: held 0.711s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Created reservations ['778cbea5-506d-41c9-a823-8f6dbb3b16a5', '3a764859-889e-441b-8814-a76c933c9bb2', '1adfec57-b530-4118-90a6-f1d6a1af4283', '672146bb-4c2b-4bbe-9441-672b889fe449'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:20:59 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:20:59 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:20:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-ff5714c1-5683-4352-a42f-c72d45fa8f4c req-1a6e16eb-5590-471a-aa32-595e7d303626 tempest-TestServerVolumeAttachmentScenario-126460277 None] Terminate volume connection completed successfully. Sep 28 05:20:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-ff5714c1-5683-4352-a42f-c72d45fa8f4c req-1a6e16eb-5590-471a-aa32-595e7d303626 tempest-TestServerVolumeAttachmentScenario-126460277 None] Deleting attachment 93ca4c61-519b-4693-bb79-081cd82a6e02. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:21:00 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.270s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:00 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Deleted volume successfully. Sep 28 05:21:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-55a04527-07c2-4441-ae2b-9d0581ca6455 tempest-CinderUnicodeTest-2107988774 None] Lock "cinder-39d8142d-6b44-427a-bfe4-77ed64f2ea04-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [req-683ac6e1-3575-4660-877a-8d6b77a5ddd6 req-15664ad4-0987-461f-b8e3-2ca589608da5 tempest-TestServerVolumeAttachmentScenario-126460277 None] Terminate volume connection completed successfully. Sep 28 05:21:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [req-683ac6e1-3575-4660-877a-8d6b77a5ddd6 req-15664ad4-0987-461f-b8e3-2ca589608da5 tempest-TestServerVolumeAttachmentScenario-126460277 None] Deleting attachment 38f0f611-74d5-4948-b0e8-4f6133b79d9f. {{(pid=86815) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "cinder-6d2629e6-38bd-46bb-8e43-e125a67177af-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-6d2629e6-38bd-46bb-8e43-e125a67177af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "cinder-quobyte-6d2629e6-38bd-46bb-8e43-e125a67177af" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-quobyte-6d2629e6-38bd-46bb-8e43-e125a67177af" acquired by "delete_volume" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78634b9-3f00-4db2-a661-5960c5cffbba]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:05 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af Sep 28 05:21:05 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:06 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:06 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af Sep 28 05:21:06 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:06 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6d2629e6-38bd-46bb-8e43-e125a67177af" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-quobyte-6d2629e6-38bd-46bb-8e43-e125a67177af" released by "delete_volume" :: held 0.644s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Created reservations ['d34b536c-0d9b-499b-b25f-1bb306b62f94', '91927855-ec13-4a26-beda-dba6e94c8705', '9464a071-c88f-4c92-83cb-7b8dbaaf7f14', 'e0f1436f-0f7f-4161-a0bf-50cba0b903f5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:06 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:06 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:06 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Deleted volume successfully. Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-97435b9a-ab7b-48fe-afcf-4171733333c1 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-6d2629e6-38bd-46bb-8e43-e125a67177af-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "cinder-8b2d61a1-f9e0-4218-b385-9b3dd549f580-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-8b2d61a1-f9e0-4218-b385-9b3dd549f580-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "cinder-quobyte-8b2d61a1-f9e0-4218-b385-9b3dd549f580" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-quobyte-8b2d61a1-f9e0-4218-b385-9b3dd549f580" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74039838-399b-4c60-90b5-7eafbe7f1af5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:07 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 Sep 28 05:21:07 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:07 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:07 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580 Sep 28 05:21:07 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:07 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8b2d61a1-f9e0-4218-b385-9b3dd549f580" returned: 0 in 0.262s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-quobyte-8b2d61a1-f9e0-4218-b385-9b3dd549f580" released by "delete_volume" :: held 0.673s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Created reservations ['51a7af09-be5e-4e91-88c7-95085998be3e', 'b1a646ff-d2e8-4bf3-809e-51b17796e1c9', 'b200fec3-1191-4b38-b7b3-3e3917b43df1', '3d94ec09-05cb-4907-b05e-0b8b0d498421'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:07 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:07 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:08 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.254s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:08 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Deleted volume successfully. Sep 28 05:21:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4aa0eb53-05a7-4af4-b50d-5ceaae271297 tempest-TestServerVolumeAttachmentScenario-126460277 None] Lock "cinder-8b2d61a1-f9e0-4218-b385-9b3dd549f580-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:17 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=81,cinder:SELECT=84,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=72,cinder:UPDATE=78,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Flow 'volume_create_manager' (aa5bc330-0749-4ecd-b7a6-3fd3b5901f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa071e6-5289-4729-bfa6-f9b283fdf16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa071e6-5289-4729-bfa6-f9b283fdf16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827503057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0560556-aea9-4c71-b392-8456402528b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bcf6580a594114beb05fc8f8576be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:19Z,use_quota=True,user_id='e1ca994b98bd474d80f2769f8ab4c1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ec3083-23ad-4ef3-a7e5-4e337d02983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ec3083-23ad-4ef3-a7e5-4e337d02983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f10a13c-dc0b-4b21-a00e-4195ba4ac795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f10a13c-dc0b-4b21-a00e-4195ba4ac795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0560556-aea9-4c71-b392-8456402528b1', 'volume_name': 'volume-b0560556-aea9-4c71-b392-8456402528b1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce768cc1-2205-49e0-9b54-98daf1fde911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce768cc1-2205-49e0-9b54-98daf1fde911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8a9c1-59e9-42b3-a0d5-eb35d00d564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:18 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Volume b0560556-aea9-4c71-b392-8456402528b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0560556-aea9-4c71-b392-8456402528b1', 'volume_size': 1} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827503057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0560556-aea9-4c71-b392-8456402528b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bcf6580a594114beb05fc8f8576be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:19Z,use_quota=True,user_id='e1ca994b98bd474d80f2769f8ab4c1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Creating volume b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:18 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:21:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:18 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 1073741824 Sep 28 05:21:18 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:19 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 1073741824" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:19 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:19 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:19 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.235s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c8a9c1-59e9-42b3-a0d5-eb35d00d564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0560556-aea9-4c71-b392-8456402528b1', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ba1b10-81b3-4309-9bb9-7c05ef9bc90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Volume volume-b0560556-aea9-4c71-b392-8456402528b1 (b0560556-aea9-4c71-b392-8456402528b1): created successfully Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ba1b10-81b3-4309-9bb9-7c05ef9bc90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Flow 'volume_create_manager' (aa5bc330-0749-4ecd-b7a6-3fd3b5901f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-90063f24-47f7-400f-8422-1b0ccdde0a3c tempest-VolumeDependencyTests-1819660840 None] Created volume successfully. Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Creating offline snapshot c0b2a402-7a75-4b27-b944-0da26e2cbf99 of volume b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17af3ce-69f4-46b2-8a00-b7e9db55c10f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:19 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:19 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:20 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.359s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:20 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 1G Sep 28 05:21:20 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:20 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 1G" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0560556-aea9-4c71-b392-8456402528b1 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:20 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0560556-aea9-4c71-b392-8456402528b1 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:20 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:20 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0560556-aea9-4c71-b392-8456402528b1 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.297s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:20 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 is being set with open permissions: ugo+rw Sep 28 05:21:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:20 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:20 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:21 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.238s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:21 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info Sep 28 05:21:21 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:21 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:21 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info is being set with open permissions: ugo+rw Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:21 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info Sep 28 05:21:21 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:21 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.info" returned: 0 in 0.235s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2615aac3-1d35-45a2-96e3-4504766a0eeb tempest-VolumeDependencyTests-1819660840 None] Create snapshot completed successfully Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Flow 'volume_create_manager' (b5b56228-cd3f-463e-bf95-5f1538d0b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9f3135-d467-42c2-933b-8d21623e5b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9f3135-d467-42c2-933b-8d21623e5b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-855338430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b992bb-fbdc-4847-b313-665f9b76c184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bcf6580a594114beb05fc8f8576be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0b2a402-7a75-4b27-b944-0da26e2cbf99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:22Z,use_quota=True,user_id='e1ca994b98bd474d80f2769f8ab4c1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29af7b3-700c-4083-92c5-abb7f4f9e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29af7b3-700c-4083-92c5-abb7f4f9e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85880119-7c2d-4eca-9a78-f0dc67b7113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85880119-7c2d-4eca-9a78-f0dc67b7113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05b992bb-fbdc-4847-b313-665f9b76c184', 'volume_name': 'volume-05b992bb-fbdc-4847-b313-665f9b76c184', 'volume_size': 1, 'snapshot_id': 'c0b2a402-7a75-4b27-b944-0da26e2cbf99'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0fa7d-a606-4c24-a944-9b3fc22df0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0fa7d-a606-4c24-a944-9b3fc22df0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf89e9-010b-466b-a3ce-1207aed8836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:22 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Volume 05b992bb-fbdc-4847-b313-665f9b76c184: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05b992bb-fbdc-4847-b313-665f9b76c184', 'volume_size': 1, 'snapshot_id': 'c0b2a402-7a75-4b27-b944-0da26e2cbf99'} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99-05b992bb-fbdc-4847-b313-665f9b76c184" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99-05b992bb-fbdc-4847-b313-665f9b76c184" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Creating volume 05b992bb-fbdc-4847-b313-665f9b76c184 from snapshot c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] snapshot: c0b2a402-7a75-4b27-b944-0da26e2cbf99, volume: 05b992bb-fbdc-4847-b313-665f9b76c184, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194eb2b-99a9-49c0-9067-cc00b5958c9d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:22 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:22 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:22 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0560556-aea9-4c71-b392-8456402528b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b6b6f7-4efa-4bfe-95b1-c3154b6c578f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:23 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:23 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:23 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:21:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:21:23 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:21:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:23 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 Sep 28 05:21:23 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:29 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184" returned: 0 in 5.847s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:21:29 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Converted 1024.00 MB image at 175.10 MB/s Sep 28 05:21:29 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 is being set with open permissions: ugo+rw Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:29 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 Sep 28 05:21:29 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:29 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" released by "_copy_volume_from_snapshot" :: held 6.886s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:29 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:29 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99-05b992bb-fbdc-4847-b313-665f9b76c184" released by "_create_volume_from_snapshot" :: held 6.943s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.957s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf89e9-010b-466b-a3ce-1207aed8836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b992bb-fbdc-4847-b313-665f9b76c184', 'volume_size': 1, 'snapshot_id': 'c0b2a402-7a75-4b27-b944-0da26e2cbf99'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238a55da-7497-4e78-a892-d446ad86a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:29 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Volume volume-05b992bb-fbdc-4847-b313-665f9b76c184 (05b992bb-fbdc-4847-b313-665f9b76c184): created successfully Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238a55da-7497-4e78-a892-d446ad86a59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Flow 'volume_create_manager' (b5b56228-cd3f-463e-bf95-5f1538d0b42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-25d2eb9b-179b-4136-88af-28f42cd55387 tempest-VolumeDependencyTests-1819660840 None] Created volume successfully. Sep 28 05:21:29 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.251s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-c0b2a402-7a75-4b27-b944-0da26e2cbf99-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-c0b2a402-7a75-4b27-b944-0da26e2cbf99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Deleting offline snapshot c0b2a402-7a75-4b27-b944-0da26e2cbf99 of volume b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] snapshot_file for this snap is: volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f5d70-32a1-4154-a6f7-7b33902c9ca3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:30 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:30 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:30 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0560556-aea9-4c71-b392-8456402528b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23d25a-7b55-471f-968e-c1941760685b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:30 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:30 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:30 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.526s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:30 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:30 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:31 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:31 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99 Sep 28 05:21:31 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:31 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1.c0b2a402-7a75-4b27-b944-0da26e2cbf99" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-c0b2a402-7a75-4b27-b944-0da26e2cbf99" released by "_delete_snapshot" :: held 1.566s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" released by "delete_snapshot" :: held 1.588s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Created reservations ['b6a611b2-516a-456e-9fba-bb806da08e6c', '2bf65d7a-9506-4114-b24d-ba56d7060d69', '57dced9d-cd31-47c7-a634-141f47af77f4', '7ca5d65f-1694-4f67-98d2-e7b2e76b3a4f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Delete snapshot completed successfully. Sep 28 05:21:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a788b1ce-b1e5-4b1f-a973-856223ba10d1 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-c0b2a402-7a75-4b27-b944-0da26e2cbf99-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-b0560556-aea9-4c71-b392-8456402528b1-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-b0560556-aea9-4c71-b392-8456402528b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a79fa4-78b0-4952-84a8-ccd0da1d9cde]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:32 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:32 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:32 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.355s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:32 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1 Sep 28 05:21:32 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:32 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b0560556-aea9-4c71-b392-8456402528b1" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-b0560556-aea9-4c71-b392-8456402528b1" released by "delete_volume" :: held 0.658s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Created reservations ['88137857-b0c5-44ca-b58c-409e15f67814', 'e7593447-cad9-42cd-9911-8a64192d7d26', '867ee6b0-81f3-4b8b-b0a9-86c26307ab04', 'aa7dfe62-6b20-4e48-9a50-ca313817bd2a'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:32 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:32 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:33 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Deleted volume successfully. Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-63bee55c-123d-4220-9715-d157615581e3 tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-b0560556-aea9-4c71-b392-8456402528b1-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-05b992bb-fbdc-4847-b313-665f9b76c184-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-05b992bb-fbdc-4847-b313-665f9b76c184-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" acquired by "delete_volume" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1ce99-e33b-4d79-a2cd-f73f5ea211e1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:33 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 Sep 28 05:21:33 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:33 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:33 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184 Sep 28 05:21:33 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:33 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05b992bb-fbdc-4847-b313-665f9b76c184" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-quobyte-05b992bb-fbdc-4847-b313-665f9b76c184" released by "delete_volume" :: held 0.634s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Created reservations ['7b40c8ca-821c-4cd4-8dcc-ee263221a29f', '2fcbe9eb-9a73-49e6-89e4-a8da05028bd7', '43503c7d-4ca2-49e2-ad4d-4bc7602147c8', 'c6dfbfa2-bae9-4ab7-9058-98a614038d78'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:34 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:34 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:34 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:34 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Deleted volume successfully. Sep 28 05:21:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-e59e9b4b-7748-4325-a391-0d251e9f66df tempest-VolumeDependencyTests-1819660840 None] Lock "cinder-05b992bb-fbdc-4847-b313-665f9b76c184-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (d07220f9-1d95-40e4-ae95-5bdca6d62a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740fa227-28c7-4945-a6f9-73599e5b8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740fa227-28c7-4945-a6f9-73599e5b8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759493362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee05156d-6746-42cf-b309-3954b034b5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:42Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bee447-39e7-4ac4-80e2-c4fe5c661b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bee447-39e7-4ac4-80e2-c4fe5c661b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ff53f-5b2d-4380-9db8-3249748554fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ff53f-5b2d-4380-9db8-3249748554fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee05156d-6746-42cf-b309-3954b034b5e0', 'volume_name': 'volume-ee05156d-6746-42cf-b309-3954b034b5e0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cee886-093b-4859-82ae-5005f1f8adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cee886-093b-4859-82ae-5005f1f8adc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee82666-5918-4b8f-a5c7-e3f7f1d25b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:41 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Volume ee05156d-6746-42cf-b309-3954b034b5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee05156d-6746-42cf-b309-3954b034b5e0', 'volume_size': 1} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759493362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee05156d-6746-42cf-b309-3954b034b5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:42Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Creating volume ee05156d-6746-42cf-b309-3954b034b5e0 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:41 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:21:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:41 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 1073741824 Sep 28 05:21:41 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:42 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 1073741824" returned: 0 in 0.410s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:42 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 Sep 28 05:21:42 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:42 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0" returned: 0 in 0.252s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee82666-5918-4b8f-a5c7-e3f7f1d25b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee05156d-6746-42cf-b309-3954b034b5e0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53338d3-65e7-4b49-8c26-0261ebdafeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:42 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Volume volume-ee05156d-6746-42cf-b309-3954b034b5e0 (ee05156d-6746-42cf-b309-3954b034b5e0): created successfully Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53338d3-65e7-4b49-8c26-0261ebdafeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (d07220f9-1d95-40e4-ae95-5bdca6d62a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b950ef4c-560e-4462-9c6a-2e9553b54fcd tempest-ProjectReaderTests-1165703763 None] Created volume successfully. Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-ee05156d-6746-42cf-b309-3954b034b5e0-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-ee05156d-6746-42cf-b309-3954b034b5e0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-quobyte-ee05156d-6746-42cf-b309-3954b034b5e0" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-ee05156d-6746-42cf-b309-3954b034b5e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c853f1e-e1b4-4109-b91c-a31082c3baa5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:43 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 Sep 28 05:21:43 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:43 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0" returned: 0 in 0.366s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:43 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0 Sep 28 05:21:43 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:43 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-ee05156d-6746-42cf-b309-3954b034b5e0" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-ee05156d-6746-42cf-b309-3954b034b5e0" released by "delete_volume" :: held 0.651s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Created reservations ['fb3cae82-b5ac-4f4c-b219-091d7786252b', '48728677-e309-4e2b-8d86-5ad761c2c726', 'e1ec4414-950c-4f5c-9534-37445ff829c1', '2e1469cb-eb24-4345-b263-9e2a2f441e09'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:43 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:43 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:44 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Deleted volume successfully. Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-96ff9827-90cf-4caf-b706-5c44c6e0fb98 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-ee05156d-6746-42cf-b309-3954b034b5e0-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (571523fc-05a3-4c14-a3bf-21594d77cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373f4a8-db9b-4e66-a194-e5cbb87b5275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373f4a8-db9b-4e66-a194-e5cbb87b5275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557780528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a13ed5-142c-4ee4-9b10-84d5221ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:44Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629bd3c-ff8d-4aaf-a17a-ff5ab8fd3510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629bd3c-ff8d-4aaf-a17a-ff5ab8fd3510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5ebce8-3bb4-48db-8a83-e7a2c4f88c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5ebce8-3bb4-48db-8a83-e7a2c4f88c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a13ed5-142c-4ee4-9b10-84d5221ccad0', 'volume_name': 'volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35ea6be-358a-4255-83ed-2b445b6acb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35ea6be-358a-4255-83ed-2b445b6acb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd71d4-efe1-4a30-9182-4995b461bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:44 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Volume b5a13ed5-142c-4ee4-9b10-84d5221ccad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0', 'volume_size': 1} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557780528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a13ed5-142c-4ee4-9b10-84d5221ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:44Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Creating volume b5a13ed5-142c-4ee4-9b10-84d5221ccad0 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:44 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:21:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:44 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 1073741824 Sep 28 05:21:44 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:45 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 1073741824" returned: 0 in 0.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:45 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 Sep 28 05:21:45 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:45 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd71d4-efe1-4a30-9182-4995b461bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab4f73b-b7bc-4223-8607-00f0189c6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Volume volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 (b5a13ed5-142c-4ee4-9b10-84d5221ccad0): created successfully Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab4f73b-b7bc-4223-8607-00f0189c6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (571523fc-05a3-4c14-a3bf-21594d77cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-fd59cf4f-b317-48a0-acfe-d28b6cbd3b61 tempest-ProjectReaderTests-1165703763 None] Created volume successfully. Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-b5a13ed5-142c-4ee4-9b10-84d5221ccad0-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "cinder-b5a13ed5-142c-4ee4-9b10-84d5221ccad0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-quobyte-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37adda63-6b98-43bf-9f86-c46637a9522d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:45 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 Sep 28 05:21:45 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:46 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:46 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0 Sep 28 05:21:46 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:46 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-b5a13ed5-142c-4ee4-9b10-84d5221ccad0" released by "delete_volume" :: held 0.645s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Created reservations ['be49bbec-86dd-4e2a-a689-cf935f161c55', '986f7f62-15ad-4dc0-842d-70db88711b5a', '600c1434-44ae-4ea9-a7b7-4506b1df328c', '8432af05-0c93-474f-aee3-1dd5d2d9cecf'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:46 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:46 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:46 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Deleted volume successfully. Sep 28 05:21:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-94708dc4-3b29-4053-81c7-2ebbc05b1c5e tempest-ProjectReaderTests-1165703763 None] Lock "cinder-b5a13ed5-142c-4ee4-9b10-84d5221ccad0-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (70913545-63b4-4848-b71d-8a7b3c5f613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53a6e4-f043-4f40-a234-0efaffa6f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53a6e4-f043-4f40-a234-0efaffa6f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581805709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d38047b-353a-4bdf-ada8-a53ecf7d6b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:47Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02d7462-10c5-4bd2-a5c6-5135168dac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02d7462-10c5-4bd2-a5c6-5135168dac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82494cf8-07ab-4e5f-beb9-8320d9a4bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82494cf8-07ab-4e5f-beb9-8320d9a4bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d38047b-353a-4bdf-ada8-a53ecf7d6b10', 'volume_name': 'volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e1279-cbd4-4f89-80f2-f1a1251623cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e1279-cbd4-4f89-80f2-f1a1251623cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5571fca-c6b7-4ccc-89ca-5fd53b66ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Volume 8d38047b-353a-4bdf-ada8-a53ecf7d6b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10', 'volume_size': 1} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581805709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d38047b-353a-4bdf-ada8-a53ecf7d6b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:47Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Creating volume 8d38047b-353a-4bdf-ada8-a53ecf7d6b10 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:47 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:47 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 1073741824 Sep 28 05:21:47 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:47 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 1073741824" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:47 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 Sep 28 05:21:47 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:47 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5571fca-c6b7-4ccc-89ca-5fd53b66ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4287f1e1-55bb-40d7-9787-2459e61d9d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Volume volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 (8d38047b-353a-4bdf-ada8-a53ecf7d6b10): created successfully Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4287f1e1-55bb-40d7-9787-2459e61d9d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (70913545-63b4-4848-b71d-8a7b3c5f613e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-902cd26b-7d81-4e48-9a7e-e48fc2177a15 tempest-ProjectReaderTests-1165703763 None] Created volume successfully. Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-8d38047b-353a-4bdf-ada8-a53ecf7d6b10-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "cinder-8d38047b-353a-4bdf-ada8-a53ecf7d6b10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-quobyte-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d12f35-c5d5-4725-9dd4-ea1753c0aa05]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:48 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 Sep 28 05:21:48 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:48 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:48 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10 Sep 28 05:21:48 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:48 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-8d38047b-353a-4bdf-ada8-a53ecf7d6b10" released by "delete_volume" :: held 0.638s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:48 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Created reservations ['519ffd46-7129-49bf-8e10-0f5d8d010e53', '8e5a6c94-6a57-44b7-87f2-fd8476e3f21f', '86717804-8552-4c61-80c0-fa05e24eef1f', 'f0562059-db5d-4ebf-8df6-28fc3ca8cab8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:49 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:49 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:49 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.238s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Deleted volume successfully. Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b75ad49-b9cf-418c-bf98-317a8bcab55a tempest-ProjectReaderTests-1165703763 None] Lock "cinder-8d38047b-353a-4bdf-ada8-a53ecf7d6b10-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (b0c2aea2-e5f6-4500-a56b-732911e64df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed687d3b-39ba-489a-8e5a-96c3bf2f3f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed687d3b-39ba-489a-8e5a-96c3bf2f3f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507949556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee94918-b046-4ebc-b178-98574051abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:50Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace65567-8f31-4738-92e3-37f0a6634cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace65567-8f31-4738-92e3-37f0a6634cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703f11b0-cf4e-4265-980e-71eb02e68726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703f11b0-cf4e-4265-980e-71eb02e68726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee94918-b046-4ebc-b178-98574051abf9', 'volume_name': 'volume-1ee94918-b046-4ebc-b178-98574051abf9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c2b2b-6963-4aa9-b4fc-9c4c5d7b3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c2b2b-6963-4aa9-b4fc-9c4c5d7b3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fc683d-6e5e-4252-ab79-f1abcaceae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:49 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Volume 1ee94918-b046-4ebc-b178-98574051abf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee94918-b046-4ebc-b178-98574051abf9', 'volume_size': 1} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507949556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee94918-b046-4ebc-b178-98574051abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd85e08689fc405eadf3a43b6fd19a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:21:50Z,use_quota=True,user_id='1e064b81ada04a27b1adb3abea7f70de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Creating volume 1ee94918-b046-4ebc-b178-98574051abf9 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:21:49 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:21:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:49 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 1073741824 Sep 28 05:21:49 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:50 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 1073741824" returned: 0 in 0.410s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:50 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 Sep 28 05:21:50 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:50 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fc683d-6e5e-4252-ab79-f1abcaceae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee94918-b046-4ebc-b178-98574051abf9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2f31ad-5de3-4bcc-8bc3-4baf1918d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:21:50 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Volume volume-1ee94918-b046-4ebc-b178-98574051abf9 (1ee94918-b046-4ebc-b178-98574051abf9): created successfully Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2f31ad-5de3-4bcc-8bc3-4baf1918d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Flow 'volume_create_manager' (b0c2aea2-e5f6-4500-a56b-732911e64df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:21:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7ce6a516-dd70-45f2-8b82-7cfea4c89439 tempest-ProjectReaderTests-1165703763 None] Created volume successfully. Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-1ee94918-b046-4ebc-b178-98574051abf9-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-1ee94918-b046-4ebc-b178-98574051abf9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "cinder-quobyte-1ee94918-b046-4ebc-b178-98574051abf9" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-1ee94918-b046-4ebc-b178-98574051abf9" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31485da-44b0-4758-86cf-3149f467159b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:21:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:51 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 Sep 28 05:21:51 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:51 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9" returned: 0 in 0.359s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:51 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9 Sep 28 05:21:51 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:51 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1ee94918-b046-4ebc-b178-98574051abf9" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-quobyte-1ee94918-b046-4ebc-b178-98574051abf9" released by "delete_volume" :: held 0.652s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Created reservations ['00e22bc9-1931-453c-a753-c0de59ad52b5', 'c5d05ec3-51e7-4a49-8b1a-eb0d956acd5a', 'af2c00b4-b435-4757-a970-864ed87a2fb6', 'ef36c76a-e776-4391-abaa-1123bda9ebd1'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:21:51 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:21:51 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:21:51 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.262s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:21:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Deleted volume successfully. Sep 28 05:21:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f6e43dcb-00ac-42e0-bef2-d2000ec40da8 tempest-ProjectReaderTests-1165703763 None] Lock "cinder-1ee94918-b046-4ebc-b178-98574051abf9-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:01 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=77,cinder:DELETE=8 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:22:01 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=69,cinder:SELECT=52,cinder:DELETE=5,cinder:INSERT=15 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Flow 'volume_create_manager' (99fd5819-b54c-49b1-b1b1-1eefafe23658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f9059f-745f-4931-9cec-5c84657cf6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f9059f-745f-4931-9cec-5c84657cf6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538081654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8419e34e-7f96-4885-9b6f-1c28f1cb9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7560cae23ac245e69b5c881dc127b09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:11Z,use_quota=True,user_id='4b0a02ddc7164e358428973c40491419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7bcc7a-1ead-4b24-8477-6eec1787a1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7bcc7a-1ead-4b24-8477-6eec1787a1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17361cb3-8e1d-4dc8-a0b3-589370fba99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17361cb3-8e1d-4dc8-a0b3-589370fba99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8419e34e-7f96-4885-9b6f-1c28f1cb9d76', 'volume_name': 'volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e7b901-04bd-4bf9-aef9-922c3a16c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e7b901-04bd-4bf9-aef9-922c3a16c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd875c7-98f2-4135-9570-aeb1c5d2b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Volume 8419e34e-7f96-4885-9b6f-1c28f1cb9d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76', 'volume_size': 1} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538081654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8419e34e-7f96-4885-9b6f-1c28f1cb9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7560cae23ac245e69b5c881dc127b09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:11Z,use_quota=True,user_id='4b0a02ddc7164e358428973c40491419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Creating volume 8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:10 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:10 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 1073741824 Sep 28 05:22:10 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:11 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 1073741824" returned: 0 in 0.401s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:11 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:11 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:11 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.239s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd875c7-98f2-4135-9570-aeb1c5d2b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0945d2-66e7-465a-b649-049b37b7acee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Volume volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 (8419e34e-7f96-4885-9b6f-1c28f1cb9d76): created successfully Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0945d2-66e7-465a-b649-049b37b7acee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Flow 'volume_create_manager' (99fd5819-b54c-49b1-b1b1-1eefafe23658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4d14154a-a2c1-4c32-bd75-bde0f26c5f1b tempest-SnapshotDependencyTests-1719164250 None] Created volume successfully. Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Creating offline snapshot a32a58cd-2428-427a-962a-5889a033074a of volume 8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ee4b5-b407-467b-bd33-0f51465edc10]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:12 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:12 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:12 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:12 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a 1G Sep 28 05:22:12 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:12 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a 1G" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:12 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:12 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:13 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.296s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:13 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a is being set with open permissions: ugo+rw Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:13 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:13 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:13 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:13 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info Sep 28 05:22:13 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:13 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:13 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info is being set with open permissions: ugo+rw Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:13 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info Sep 28 05:22:13 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:13 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.info" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5ea07452-6142-41f4-9784-2f38118f1ee7 tempest-SnapshotDependencyTests-1719164250 None] Create snapshot completed successfully Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Flow 'volume_create_manager' (875e72cd-e01b-4b58-9d28-bf3c3abe3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47886cb1-9020-40e5-98ea-9bb8bae8e060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47886cb1-9020-40e5-98ea-9bb8bae8e060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40653de0-3f53-4762-84ec-4dfde52fbc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7560cae23ac245e69b5c881dc127b09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a32a58cd-2428-427a-962a-5889a033074a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:15Z,use_quota=True,user_id='4b0a02ddc7164e358428973c40491419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b847bac0-5391-48e0-bacc-dbade4fba6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b847bac0-5391-48e0-bacc-dbade4fba6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b736f1ef-d62d-4548-8c83-2f4dfb807dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b736f1ef-d62d-4548-8c83-2f4dfb807dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40653de0-3f53-4762-84ec-4dfde52fbc6f', 'volume_name': 'volume-40653de0-3f53-4762-84ec-4dfde52fbc6f', 'volume_size': 1, 'snapshot_id': 'a32a58cd-2428-427a-962a-5889a033074a'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81e8e2e-400e-4bf2-89db-bfa036a89d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81e8e2e-400e-4bf2-89db-bfa036a89d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d769f06f-28bb-4a48-98aa-e9a0291aebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:14 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Volume 40653de0-3f53-4762-84ec-4dfde52fbc6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40653de0-3f53-4762-84ec-4dfde52fbc6f', 'volume_size': 1, 'snapshot_id': 'a32a58cd-2428-427a-962a-5889a033074a'} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a-40653de0-3f53-4762-84ec-4dfde52fbc6f" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a-40653de0-3f53-4762-84ec-4dfde52fbc6f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Creating volume 40653de0-3f53-4762-84ec-4dfde52fbc6f from snapshot a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] snapshot: a32a58cd-2428-427a-962a-5889a033074a, volume: 40653de0-3f53-4762-84ec-4dfde52fbc6f, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b5cf61-bb5c-49ed-ab6c-d9ce19c138ea]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:14 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:14 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:15 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ce8c1-0947-4e36-ab17-2155a5908441]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:15 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:15 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:15 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.360s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:22:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:15 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f Sep 28 05:22:15 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:21 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f" returned: 0 in 5.882s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:22:21 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Converted 1024.00 MB image at 174.04 MB/s Sep 28 05:22:21 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f is being set with open permissions: ugo+rw Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:21 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f Sep 28 05:22:21 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:21 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" released by "_copy_volume_from_snapshot" :: held 6.921s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a-40653de0-3f53-4762-84ec-4dfde52fbc6f" released by "_create_volume_from_snapshot" :: held 6.984s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.999s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d769f06f-28bb-4a48-98aa-e9a0291aebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40653de0-3f53-4762-84ec-4dfde52fbc6f', 'volume_size': 1, 'snapshot_id': 'a32a58cd-2428-427a-962a-5889a033074a'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9414a5e8-c8c2-4485-b50d-08317640dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Volume volume-40653de0-3f53-4762-84ec-4dfde52fbc6f (40653de0-3f53-4762-84ec-4dfde52fbc6f): created successfully Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9414a5e8-c8c2-4485-b50d-08317640dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Flow 'volume_create_manager' (875e72cd-e01b-4b58-9d28-bf3c3abe3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-85f7bdd3-a24a-4da3-b4a0-800bc9d13024 tempest-SnapshotDependencyTests-1719164250 None] Created volume successfully. Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-a32a58cd-2428-427a-962a-5889a033074a-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-a32a58cd-2428-427a-962a-5889a033074a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Deleting offline snapshot a32a58cd-2428-427a-962a-5889a033074a of volume 8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] snapshot_file for this snap is: volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6507de2-f55c-45a6-b0d4-dc81bba8f5dd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:22 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:22 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:22 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[893669a3-6438-4938-bf87-a74f855eddac]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:22 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:22 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:23 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.532s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:23 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:23 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:23 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.326s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:23 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a Sep 28 05:22:23 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:23 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76.a32a58cd-2428-427a-962a-5889a033074a" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-a32a58cd-2428-427a-962a-5889a033074a" released by "_delete_snapshot" :: held 1.564s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" released by "delete_snapshot" :: held 1.586s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Created reservations ['ed6bcabf-9c8b-435b-a3b0-fcc4b0921023', '6563f62a-6c7f-45cb-8402-09fde8c9e831', 'f508604b-e112-4608-870e-b4b8539eb238', 'f722a7cb-70e1-4c85-8d27-c52667e46312'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:22:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Delete snapshot completed successfully. Sep 28 05:22:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-49851dd7-1948-45f9-8008-d8a806cc1f66 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-a32a58cd-2428-427a-962a-5889a033074a-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-8419e34e-7f96-4885-9b6f-1c28f1cb9d76-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-8419e34e-7f96-4885-9b6f-1c28f1cb9d76-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3560470-5155-4ce3-ab24-6201a1d7b1cb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:24 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:24 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:24 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.370s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:24 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76 Sep 28 05:22:24 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:25 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-8419e34e-7f96-4885-9b6f-1c28f1cb9d76" released by "delete_volume" :: held 0.674s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Created reservations ['135c79ca-3438-45cc-b291-25693fbb2604', '5735325f-97ea-4a35-a12f-07ce548e0d92', '832569d8-f09c-4b45-b378-d10a0407d1f7', 'ba794b97-0b4f-4738-ab29-6153694c969c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:25 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:22:25 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:25 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:22:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Deleted volume successfully. Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d356c111-7e0f-449b-ac91-f7893a9c3955 tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-8419e34e-7f96-4885-9b6f-1c28f1cb9d76-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-40653de0-3f53-4762-84ec-4dfde52fbc6f-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-40653de0-3f53-4762-84ec-4dfde52fbc6f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923e939-1a32-4be0-9ea5-d9b6e57aa4ee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:25 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f Sep 28 05:22:25 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:25 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:25 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f Sep 28 05:22:25 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:26 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-40653de0-3f53-4762-84ec-4dfde52fbc6f" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-quobyte-40653de0-3f53-4762-84ec-4dfde52fbc6f" released by "delete_volume" :: held 0.641s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Created reservations ['e3d36d2f-703f-404b-9375-35dee8f1e4d1', '9c643cc4-a041-4443-abeb-aa42d22a0243', '4d14fc21-0a42-40bb-8b2a-b2c6001a144d', '995d7db8-5aab-4a91-b531-97a1d128bb80'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:26 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:22:26 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:26 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:22:26 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Deleted volume successfully. Sep 28 05:22:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b523d1b3-86e6-4615-a8c2-48dbac4f907b tempest-SnapshotDependencyTests-1719164250 None] Lock "cinder-40653de0-3f53-4762-84ec-4dfde52fbc6f-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:29 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:22:29 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:29 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.240s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:22:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:22:36 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:22:36 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (77172548-244d-4633-9174-9028b2612c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f63616-9888-46a0-b13f-667c8a09a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f63616-9888-46a0-b13f-667c8a09a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836065203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97303b2b-e832-4ae1-a407-b60cd0e8f484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:47Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314b83e0-1715-44ee-a61f-f08d3c6364d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314b83e0-1715-44ee-a61f-f08d3c6364d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31962b13-d19d-4f5f-b7b3-0e601bd53b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31962b13-d19d-4f5f-b7b3-0e601bd53b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97303b2b-e832-4ae1-a407-b60cd0e8f484', 'volume_name': 'volume-97303b2b-e832-4ae1-a407-b60cd0e8f484', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcda6ba7-75ab-4c43-b71b-ded6de818c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcda6ba7-75ab-4c43-b71b-ded6de818c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d893bed7-d84e-4484-9f16-97b5ce88181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume 97303b2b-e832-4ae1-a407-b60cd0e8f484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97303b2b-e832-4ae1-a407-b60cd0e8f484', 'volume_size': 1} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1836065203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97303b2b-e832-4ae1-a407-b60cd0e8f484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:47Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume 97303b2b-e832-4ae1-a407-b60cd0e8f484 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:47 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:47 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 1073741824 Sep 28 05:22:47 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (eb737743-e504-471f-a756-070fb9bc9921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7ec8e8-942f-4cfa-b8f8-c995f6680b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7ec8e8-942f-4cfa-b8f8-c995f6680b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333988501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c63a793-265e-435c-872f-46d01cc04f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:47Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d75b3bc-9033-4047-b6c8-d48a494601b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d75b3bc-9033-4047-b6c8-d48a494601b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2ac322-883e-4dfc-80e7-196dfdfc69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2ac322-883e-4dfc-80e7-196dfdfc69a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c63a793-265e-435c-872f-46d01cc04f15', 'volume_name': 'volume-5c63a793-265e-435c-872f-46d01cc04f15', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e197a58-a704-4e57-83f4-c7df58e9beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e197a58-a704-4e57-83f4-c7df58e9beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40523762-2eb6-4c21-80a6-415930a446a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:47 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 5c63a793-265e-435c-872f-46d01cc04f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c63a793-265e-435c-872f-46d01cc04f15', 'volume_size': 1} Sep 28 05:22:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:48 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 1073741824" returned: 0 in 0.550s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:48 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 Sep 28 05:22:48 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:48 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484" returned: 0 in 0.292s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333988501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c63a793-265e-435c-872f-46d01cc04f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:47Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:48 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d893bed7-d84e-4484-9f16-97b5ce88181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97303b2b-e832-4ae1-a407-b60cd0e8f484', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98df0b-eea9-4f88-8580-46062ed4bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:48 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 1073741824 Sep 28 05:22:48 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:48 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 (97303b2b-e832-4ae1-a407-b60cd0e8f484): created successfully Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98df0b-eea9-4f88-8580-46062ed4bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:48 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (77172548-244d-4633-9174-9028b2612c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e9e2658f-fe84-4890-8eb4-f22fb35641dc tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:49 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 1073741824" returned: 0 in 0.534s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:49 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 Sep 28 05:22:49 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:49 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40523762-2eb6-4c21-80a6-415930a446a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c63a793-265e-435c-872f-46d01cc04f15', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4385ca43-86ab-4f0e-95e7-981d8f2ad1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:49 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-5c63a793-265e-435c-872f-46d01cc04f15 (5c63a793-265e-435c-872f-46d01cc04f15): created successfully Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4385ca43-86ab-4f0e-95e7-981d8f2ad1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:49 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (eb737743-e504-471f-a756-070fb9bc9921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3c28195f-a251-46bf-9a72-748bb97cefea tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (175317fd-4f4e-41e6-90cd-16c63179c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26603f06-7324-4643-a34f-a8d0d21eaf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26603f06-7324-4643-a34f-a8d0d21eaf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696474009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6207c5e0-6877-47e1-9073-fc017b6821c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:50Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3b91d-a065-41ab-949a-90d7e6603443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a3b91d-a065-41ab-949a-90d7e6603443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3d877f-0f2e-4bcd-900e-81a68cda536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3d877f-0f2e-4bcd-900e-81a68cda536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6207c5e0-6877-47e1-9073-fc017b6821c7', 'volume_name': 'volume-6207c5e0-6877-47e1-9073-fc017b6821c7', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef31ede-c749-4c1d-87b0-97afca1b7ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef31ede-c749-4c1d-87b0-97afca1b7ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba91c2-24ae-484b-92e1-7787df86f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume 6207c5e0-6877-47e1-9073-fc017b6821c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6207c5e0-6877-47e1-9073-fc017b6821c7', 'volume_size': 1} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696474009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6207c5e0-6877-47e1-9073-fc017b6821c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:50Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume 6207c5e0-6877-47e1-9073-fc017b6821c7 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:50 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:50 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 1073741824 Sep 28 05:22:50 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:50 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 1073741824" returned: 0 in 0.617s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:50 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 Sep 28 05:22:50 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (ff0f7ded-b386-4f9c-b0ca-a13c9c63e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f582bc7c-aa55-45c8-b867-4aac1ff15441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f582bc7c-aa55-45c8-b867-4aac1ff15441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093385364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe43c9d-6034-4e1a-8efc-f05041bdacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fc55ec-73be-4e39-aa47-7d356cb31c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fc55ec-73be-4e39-aa47-7d356cb31c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb7ac15-c50b-40d8-a053-a7987b87d1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb7ac15-c50b-40d8-a053-a7987b87d1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe43c9d-6034-4e1a-8efc-f05041bdacbd', 'volume_name': 'volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032b816-7762-489f-b045-5bc6e77c6430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032b816-7762-489f-b045-5bc6e77c6430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ab2950-236e-47b3-9f60-60ed1aaf3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:50 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume 0fe43c9d-6034-4e1a-8efc-f05041bdacbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd', 'volume_size': 1} Sep 28 05:22:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Flow 'volume_create_manager' (4c4834cc-e0a4-40aa-b156-06f10a184661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb0aef7-4d89-478b-9a9a-1ecda1f5b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb0aef7-4d89-478b-9a9a-1ecda1f5b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f9e22d-5e66-4a42-8991-4543819cab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c3473e0c554ad88c197fdc43039052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='70af26c766d64eb8a101eb72464d189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5326f178-df46-4d2d-be8e-aa404b58a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5326f178-df46-4d2d-be8e-aa404b58a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daaa66a-fb83-452f-9ccb-186fb74375c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:51 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (b06c21d4-be8b-4e62-9fd2-67ab452d89fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2c73a5-65b4-4924-8465-da18ae05bd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7" returned: 0 in 0.430s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093385364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe43c9d-6034-4e1a-8efc-f05041bdacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume 0fe43c9d-6034-4e1a-8efc-f05041bdacbd {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2c73a5-65b4-4924-8465-da18ae05bd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175004900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7f121-32b1-452b-9ce6-b6838008c9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586c4d44-8258-46f7-adc5-e7f4e0ad83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586c4d44-8258-46f7-adc5-e7f4e0ad83a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd78ec3-0d9a-4ede-8ec0-c72137a5d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd 1073741824 Sep 28 05:22:51 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd78ec3-0d9a-4ede-8ec0-c72137a5d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a7f121-32b1-452b-9ce6-b6838008c9f6', 'volume_name': 'volume-43a7f121-32b1-452b-9ce6-b6838008c9f6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624db64b-6de8-4af2-9432-017226d60e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624db64b-6de8-4af2-9432-017226d60e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc6866f-fb50-441d-8607-81fe234fdf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume 43a7f121-32b1-452b-9ce6-b6838008c9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a7f121-32b1-452b-9ce6-b6838008c9f6', 'volume_size': 1} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba91c2-24ae-484b-92e1-7787df86f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6207c5e0-6877-47e1-9073-fc017b6821c7', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507bde11-6a10-4ba4-a3e1-bef3c2714265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-6207c5e0-6877-47e1-9073-fc017b6821c7 (6207c5e0-6877-47e1-9073-fc017b6821c7): created successfully Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507bde11-6a10-4ba4-a3e1-bef3c2714265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (175317fd-4f4e-41e6-90cd-16c63179c8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8308a742-362b-4219-9e52-b983e10ca720 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daaa66a-fb83-452f-9ccb-186fb74375c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31f9e22d-5e66-4a42-8991-4543819cab15', 'volume_name': 'volume-31f9e22d-5e66-4a42-8991-4543819cab15', 'volume_size': 1, 'image_id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfba5919b73536212aad1c4fc6191cfa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0c3473e0c554ad88c197fdc43039052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af6a5566954e59121dd0d5c1678be02353f290a87f68a8fb125d8c4fc81505a3bc8d2f0bb85c91593ad1b6422701c460b9a5c58f28b6cdc9e1ee784e044bda03', 'id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/910cdf20-276b-48e5-92e1-10fd32216ee2/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a7b82e-8608-4330-a524-18aed1f93e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a7b82e-8608-4330-a524-18aed1f93e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa39de63-5012-43a8-a29a-4252c3663684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Volume 31f9e22d-5e66-4a42-8991-4543819cab15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31f9e22d-5e66-4a42-8991-4543819cab15', 'volume_size': 1, 'image_id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfba5919b73536212aad1c4fc6191cfa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0c3473e0c554ad88c197fdc43039052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af6a5566954e59121dd0d5c1678be02353f290a87f68a8fb125d8c4fc81505a3bc8d2f0bb85c91593ad1b6422701c460b9a5c58f28b6cdc9e1ee784e044bda03', 'id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/910cdf20-276b-48e5-92e1-10fd32216ee2/file', 'properties': {}}, 'image_service': } Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Trying to clone 31f9e22d-5e66-4a42-8991-4543819cab15 from image 910cdf20-276b-48e5-92e1-10fd32216ee2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:22:51 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Image download 0.00 MB at 0.00 MB/s Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf10910-900f-48f7-a4ad-470c10dc3b16]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Flow 'volume_create_manager' (76725165-b211-427e-b02c-bce68256e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a4457d-2a08-4337-818e-d1d5791be648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a4457d-2a08-4337-818e-d1d5791be648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7486180-5a5c-44a4-a3e6-459605dec2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccd81d72a944832bf68de64311c58d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='8f609f745ad64e83afe7bab31e54612c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91dbf559-98ea-4c0b-89f4-ff5ee43546fb),volume_type_id=91dbf559-98ea-4c0b-89f4-ff5ee43546fb)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88edf2d-fe0a-4c78-ab5d-24982920a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88edf2d-fe0a-4c78-ab5d-24982920a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70611558-f6ec-44eb-8aa8-cf2225499e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.image.glance [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Creating Keystone auth plugin from conf {{(pid=86815) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd 1073741824" returned: 0 in 0.751s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (5d569662-6a82-4146-84ac-96110f62b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a99b94-1d1a-44ef-b634-6f144012993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a99b94-1d1a-44ef-b634-6f144012993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497962563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6ac66d-5ef3-471d-8b2a-22920defc5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84251bb7-2142-4f42-b14f-e592207a2911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84251bb7-2142-4f42-b14f-e592207a2911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:52 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf3a4e5-dd2f-4569-a39b-2db30b398a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf3a4e5-dd2f-4569-a39b-2db30b398a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6ac66d-5ef3-471d-8b2a-22920defc5a5', 'volume_name': 'volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d8b824-48d4-4188-bda4-1cc20fa40534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d8b824-48d4-4188-bda4-1cc20fa40534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc01f0-4197-4ed7-a33c-a2927239f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume aa6ac66d-5ef3-471d-8b2a-22920defc5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5', 'volume_size': 1} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:52 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd Sep 28 05:22:52 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (db8f39dd-1ed9-4516-83bd-b1b3922725a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aefd555-40e8-419b-9a2b-f71c535b0cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aefd555-40e8-419b-9a2b-f71c535b0cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975118990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168861f9-a7e1-430a-a250-c3b7e76c0c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2628c8-8552-4e44-beff-5c5a51757910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2628c8-8552-4e44-beff-5c5a51757910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab95541-bd1b-4727-9250-625c01b91424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab95541-bd1b-4727-9250-625c01b91424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168861f9-a7e1-430a-a250-c3b7e76c0c22', 'volume_name': 'volume-168861f9-a7e1-430a-a250-c3b7e76c0c22', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774cdb06-2694-4c61-b540-a9c8e2d7384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774cdb06-2694-4c61-b540-a9c8e2d7384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039341f-0e91-4c9e-8292-b3321e30015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume 168861f9-a7e1-430a-a250-c3b7e76c0c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168861f9-a7e1-430a-a250-c3b7e76c0c22', 'volume_size': 1} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:52 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70611558-f6ec-44eb-8aa8-cf2225499e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7486180-5a5c-44a4-a3e6-459605dec2aa', 'volume_name': 'volume-a7486180-5a5c-44a4-a3e6-459605dec2aa', 'volume_size': 1, 'image_id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dcaf854771fa9ae77153eb7ddbca9613', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ccd81d72a944832bf68de64311c58d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1309a240f2d1f854cb679fb4fabf799bbb3d978c9f7700b1d5006d2ddd10faf9f12d883d4d56b080b8d4645af051be57e493ee06a2098dbe920425f27f0c370', 'id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d6fee1c-9005-432e-a5ae-05d582879106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d369e33a-e941-43b6-99fa-6b7110d21612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d369e33a-e941-43b6-99fa-6b7110d21612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849dc83-be29-4d05-8fa4-60b9363f43db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Volume a7486180-5a5c-44a4-a3e6-459605dec2aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7486180-5a5c-44a4-a3e6-459605dec2aa', 'volume_size': 1, 'image_id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dcaf854771fa9ae77153eb7ddbca9613', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ccd81d72a944832bf68de64311c58d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1309a240f2d1f854cb679fb4fabf799bbb3d978c9f7700b1d5006d2ddd10faf9f12d883d4d56b080b8d4645af051be57e493ee06a2098dbe920425f27f0c370', 'id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d6fee1c-9005-432e-a5ae-05d582879106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Trying to clone a7486180-5a5c-44a4-a3e6-459605dec2aa from image 8d6fee1c-9005-432e-a5ae-05d582879106 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}]). {{(pid=86815) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:52 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" returned: 0 in 0.299s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Image download 0.00 MB at 0.00 MB/s Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating offline snapshot 14658c3b-a579-4574-b1e9-0a875a67a6fb of volume 5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ab2950-236e-47b3-9f60-60ed1aaf3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583d2799-2482-43e4-a8a4-56926ba59724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:52 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:52 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19608f00-e9ce-43a4-9882-408d3bf13739]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd (0fe43c9d-6034-4e1a-8efc-f05041bdacbd): created successfully Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583d2799-2482-43e4-a8a4-56926ba59724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (ff0f7ded-b386-4f9c-b0ca-a13c9c63e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdf2f1-3ca3-4932-a4c8-6dbf1b021c52]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-decdb006-56ef-4bf5-9ee3-e55ced1b2b29 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:52 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 Sep 28 05:22:52 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:52 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:22:52 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:52 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Temporary image 910cdf20-276b-48e5-92e1-10fd32216ee2 is fetched for user 70af26c766d64eb8a101eb72464d189c. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35270387-107b-464d-babc-30554a8e4f81]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15" returned: 0 in 0.436s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb 1G Sep 28 05:22:53 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:22:53 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:53 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Temporary image 8d6fee1c-9005-432e-a5ae-05d582879106 is fetched for user 8f609f745ad64e83afe7bab31e54612c. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480f06a-1e98-4217-ad03-1ea96b8e578e]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb 1G" returned: 0 in 0.472s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c63a793-265e-435c-872f-46d01cc04f15 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c63a793-265e-435c-872f-46d01cc04f15 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb Sep 28 05:22:53 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:22:53 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:53 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c63a793-265e-435c-872f-46d01cc04f15 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb" returned: 0 in 0.309s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb is being set with open permissions: ugo+rw Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:53 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb Sep 28 05:22:53 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:53 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:22:53 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:54 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:54 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info Sep 28 05:22:54 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:54 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:54 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info" returned: 0 in 0.262s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:54 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info is being set with open permissions: ugo+rw Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:54 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info Sep 28 05:22:54 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:54 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.info" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175004900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7f121-32b1-452b-9ce6-b6838008c9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume 43a7f121-32b1-452b-9ce6-b6838008c9f6 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:54 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:54 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 1073741824 Sep 28 05:22:54 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:54 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1456a558-7b2a-433a-81a3-8a7a35c63dcd tempest-CreateVolumesFromSnapshotTest-1405529433 None] Create snapshot completed successfully Sep 28 05:22:55 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 1073741824" returned: 0 in 0.422s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:55 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 Sep 28 05:22:55 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:55 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497962563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6ac66d-5ef3-471d-8b2a-22920defc5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume aa6ac66d-5ef3-471d-8b2a-22920defc5a5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:55 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc6866f-fb50-441d-8607-81fe234fdf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a7f121-32b1-452b-9ce6-b6838008c9f6', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6b0431-10fb-4819-ad00-f34bd9e3b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:55 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 1073741824 Sep 28 05:22:55 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:55 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 (43a7f121-32b1-452b-9ce6-b6838008c9f6): created successfully Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6b0431-10fb-4819-ad00-f34bd9e3b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (b06c21d4-be8b-4e62-9fd2-67ab452d89fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-47e98f05-6ac1-4b93-a7e1-e40a8964ba39 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:55 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 1073741824" returned: 0 in 0.475s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:55 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 Sep 28 05:22:55 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:56 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" returned: 0 in 0.280s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975118990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168861f9-a7e1-430a-a250-c3b7e76c0c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d050e438b1ce46c993b4b7bd2df13792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='197143a5b4f443f799bfcf86348a67d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Creating volume 168861f9-a7e1-430a-a250-c3b7e76c0c22 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:56 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc01f0-4197-4ed7-a33c-a2927239f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 1073741824 Sep 28 05:22:56 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5c53b5-e605-4d2f-81a4-248186a40390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (0efdbefb-8922-4d1a-8479-9f6a9a362362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d7813c-789c-4274-9ce5-a2e5beacde1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 (aa6ac66d-5ef3-471d-8b2a-22920defc5a5): created successfully Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5c53b5-e605-4d2f-81a4-248186a40390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (5d569662-6a82-4146-84ac-96110f62b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d7813c-789c-4274-9ce5-a2e5beacde1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567580005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f18daa7-0317-46e4-a3e8-2acbbadfd9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:56Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3df32b-f8c8-4df1-b0a2-7ac561a9f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3df32b-f8c8-4df1-b0a2-7ac561a9f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba878a-4941-424b-80c5-f1ab32de62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba878a-4941-424b-80c5-f1ab32de62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f18daa7-0317-46e4-a3e8-2acbbadfd9b9', 'volume_name': 'volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c31c6f2-7474-40c7-b5e1-5ea25ac62820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c31c6f2-7474-40c7-b5e1-5ea25ac62820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec31fa2-c98a-4f63-9295-5b39945314ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 8f18daa7-0317-46e4-a3e8-2acbbadfd9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9', 'volume_size': 1} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4b46329e-9993-45a4-92f1-727f2ae47cc6 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (217ebdab-c44e-454f-b73e-cb149149362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6fe522-5f0a-458a-ba54-7f627a682fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6fe522-5f0a-458a-ba54-7f627a682fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-227856778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01891ba1-c261-4c9a-bed4-efbf340cf740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:56Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6493ec11-e254-4f6b-b9cc-746a46b3dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6493ec11-e254-4f6b-b9cc-746a46b3dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c882b2-36a4-4ef2-872f-1c1a6df42294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c882b2-36a4-4ef2-872f-1c1a6df42294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01891ba1-c261-4c9a-bed4-efbf340cf740', 'volume_name': 'volume-01891ba1-c261-4c9a-bed4-efbf340cf740', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d519280-6119-4784-ac84-fadb18906dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d519280-6119-4784-ac84-fadb18906dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e2a2aa-3c4e-4a24-8c2b-dfa2fe0a6789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:56 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 01891ba1-c261-4c9a-bed4-efbf340cf740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01891ba1-c261-4c9a-bed4-efbf340cf740', 'volume_size': 1} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:56 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 1073741824" returned: 0 in 0.678s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:56 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 Sep 28 05:22:56 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (b4cb065c-5eff-4fc5-a9ac-55a214e9496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadfb0de-0c41-47a2-bcc4-bdaec121ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadfb0de-0c41-47a2-bcc4-bdaec121ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566676952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9263e48e-e512-4a75-b8ce-8a9f32de1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:57Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a36403-c1e3-4701-9796-e6b70eb42ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a36403-c1e3-4701-9796-e6b70eb42ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef15f43-6399-4655-8dd7-07c957da763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef15f43-6399-4655-8dd7-07c957da763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9263e48e-e512-4a75-b8ce-8a9f32de1d76', 'volume_name': 'volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a2a88-d8b7-4637-9afc-16540b02b1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a2a88-d8b7-4637-9afc-16540b02b1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3ec18-02a9-4336-abc6-18c99bc70b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 9263e48e-e512-4a75-b8ce-8a9f32de1d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76', 'volume_size': 1} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:57 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.592s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f9e22d-5e66-4a42-8991-4543819cab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c3473e0c554ad88c197fdc43039052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:51Z,use_quota=True,user_id='70af26c766d64eb8a101eb72464d189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Creating volume 31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:57 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c039341f-0e91-4c9e-8292-b3321e30015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168861f9-a7e1-430a-a250-c3b7e76c0c22', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1073741824 Sep 28 05:22:57 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906afa21-4075-49d0-a562-624695f6220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Volume volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 (168861f9-a7e1-430a-a250-c3b7e76c0c22): created successfully Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906afa21-4075-49d0-a562-624695f6220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Flow 'volume_create_manager' (db8f39dd-1ed9-4516-83bd-b1b3922725a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:57 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-25156a84-42a0-4179-8ef0-0120d43c8f00 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created volume successfully. Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (13baa507-5075-4e47-bbdf-141d30b2d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a633521d-0f15-4413-ab9c-8a1f5d6b7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a633521d-0f15-4413-ab9c-8a1f5d6b7f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950668510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae21d9-c06a-4458-8e4d-a8c126bdbd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:57Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3200ed7-be6d-4fa9-bbd4-b73590880876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3200ed7-be6d-4fa9-bbd4-b73590880876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cedbc6-7dc1-4b1d-9951-2ebb22639302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cedbc6-7dc1-4b1d-9951-2ebb22639302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dae21d9-c06a-4458-8e4d-a8c126bdbd62', 'volume_name': 'volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dcbfaa-2ca0-4b68-aaab-5e1e358daab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dcbfaa-2ca0-4b68-aaab-5e1e358daab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7ac9cd-a9f9-45bd-80f1-00b727a193b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 5dae21d9-c06a-4458-8e4d-a8c126bdbd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62', 'volume_size': 1} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:57 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1073741824" returned: 0 in 0.500s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:57 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 Sep 28 05:22:57 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (910ba4e8-becf-4480-b6a8-bc6216bb7858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8813b55f-2d49-4da4-954d-164fd324cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-168861f9-a7e1-430a-a250-c3b7e76c0c22-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8813b55f-2d49-4da4-954d-164fd324cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065642940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e5926-c17d-45a1-8164-a63b9880420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:58Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100b0f6b-907b-4558-8eb3-50a5490de851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100b0f6b-907b-4558-8eb3-50a5490de851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04efa2f6-1cad-49c5-9efe-fc277b1784f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04efa2f6-1cad-49c5-9efe-fc277b1784f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1e5926-c17d-45a1-8164-a63b9880420a', 'volume_name': 'volume-3a1e5926-c17d-45a1-8164-a63b9880420a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b16dd8-8f10-4915-8bf1-65b23b50be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b16dd8-8f10-4915-8bf1-65b23b50be5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6a5325-6ad6-4245-9b11-128fd9f05ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:22:58 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume 3a1e5926-c17d-45a1-8164-a63b9880420a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1e5926-c17d-45a1-8164-a63b9880420a', 'volume_size': 1} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-168861f9-a7e1-430a-a250-c3b7e76c0c22-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-168861f9-a7e1-430a-a250-c3b7e76c0c22" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:58 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-168861f9-a7e1-430a-a250-c3b7e76c0c22" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.961s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7486180-5a5c-44a4-a3e6-459605dec2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccd81d72a944832bf68de64311c58d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:52Z,use_quota=True,user_id='8f609f745ad64e83afe7bab31e54612c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91dbf559-98ea-4c0b-89f4-ff5ee43546fb),volume_type_id=91dbf559-98ea-4c0b-89f4-ff5ee43546fb)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Creating volume a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:58 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abfb891-f7b6-4123-b033-c09afe3340ab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1073741824 Sep 28 05:22:58 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Attempting download of 910cdf20-276b-48e5-92e1-10fd32216ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}])) to volume 31f9e22d-5e66-4a42-8991-4543819cab15. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266b9c2-7a7c-4635-85d9-6f80a0d4f7c4]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 Sep 28 05:22:58 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug Sep 28 05:22:58 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22 Sep 28 05:22:58 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug" returned: 0 in 0.346s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1073741824" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa Sep 28 05:22:58 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug Sep 28 05:22:58 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-168861f9-a7e1-430a-a250-c3b7e76c0c22" returned: 0 in 0.263s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-168861f9-a7e1-430a-a250-c3b7e76c0c22" released by "delete_volume" :: held 0.710s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['7f9a7bab-d72d-492e-a45b-1c7c9473f8fb', 'e776d25f-3aed-4ab1-a7b3-4c9000a584b8', '62eda1d1-a47d-491b-8f9b-f4f64e8d34a3', '6646b4ce-c5b6-4c6c-9a2a-4a927f32d2ac'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:22:58 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567580005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f18daa7-0317-46e4-a3e8-2acbbadfd9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:56Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:58 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:58 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug" returned: 1 in 0.388s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_910cdf20-276b-48e5-92e1-10fd32216ee2_pzfc5dug' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:58 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 1073741824 Sep 28 05:22:58 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f22efe-9640-44c6-85d4-5854a075dd43]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Attempting download of 8d6fee1c-9005-432e-a5ae-05d582879106 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}])) to volume a7486180-5a5c-44a4-a3e6-459605dec2aa. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 05:22:59 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:22:59 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66bea74-1c40-48c8-aa6a-fbdbc03e23c4]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:59 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b Sep 28 05:22:59 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.420s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:22:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-aa6ac66d-5ef3-471d-8b2a-22920defc5a5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-027fe8a4-2463-4299-b564-9cf07fcf82e5 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-168861f9-a7e1-430a-a250-c3b7e76c0c22-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-aa6ac66d-5ef3-471d-8b2a-22920defc5a5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:59 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 1073741824" returned: 0 in 0.600s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD Sep 28 05:22:59 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e698e1-cd26-43c6-bb5d-65efdc879bf3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 Sep 28 05:22:59 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b" returned: 0 in 0.509s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 Sep 28 05:22:59 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b Sep 28 05:22:59 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] 910cdf20-276b-48e5-92e1-10fd32216ee2 was raw, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:22:59 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 Sep 28 05:22:59 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:22:59 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.330s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-227856778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01891ba1-c261-4c9a-bed4-efbf340cf740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:56Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 01891ba1-c261-4c9a-bed4-efbf340cf740 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:22:59 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:22:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec31fa2-c98a-4f63-9295-5b39945314ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d1984-fd7f-4d62-bd42-9aaf10d0505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 (8f18daa7-0317-46e4-a3e8-2acbbadfd9b9): created successfully Sep 28 05:23:00 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 1073741824 Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d1984-fd7f-4d62-bd42-9aaf10d0505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:00 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (0efdbefb-8922-4d1a-8479-9f6a9a362362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-92129ad5-05a3-4405-bdab-415605869d00 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:23:00 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b" returned: 1 in 0.445s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d6fee1c-9005-432e-a5ae-05d582879106_26efr_7b' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03071dbd-2400-4dc4-9bc9-7e71b400b464]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" returned: 0 in 0.489s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5 Sep 28 05:23:00 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:23:00 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15" returned: 0 in 0.606s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_910cdf20-276b-48e5-92e1-10fd32216ee2_4jolr_frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-aa6ac66d-5ef3-471d-8b2a-22920defc5a5" released by "delete_volume" :: held 0.892s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:00 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1G Sep 28 05:23:00 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 1073741824" returned: 0 in 0.539s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 Sep 28 05:23:00 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['c24f9a1c-1603-4ce2-9485-ecc5514028d5', '9432e8b2-6a5c-447b-bf0e-c6ac08493a1c', '5036700f-db88-4447-a376-f75038f500ba', 'ee26cd56-49f1-4dfb-b213-5cdd7cfc2dc6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD Sep 28 05:23:00 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:00 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 1G" returned: 0 in 0.394s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Downloaded image 910cdf20-276b-48e5-92e1-10fd32216ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}])) to volume 31f9e22d-5e66-4a42-8991-4543819cab15 successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:23:00 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Temporary image 910cdf20-276b-48e5-92e1-10fd32216ee2 for user 70af26c766d64eb8a101eb72464d189c is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Marking volume 31f9e22d-5e66-4a42-8991-4543819cab15 as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566676952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9263e48e-e512-4a75-b8ce-8a9f32de1d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:57Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 9263e48e-e512-4a75-b8ce-8a9f32de1d76 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Copying metadata from image 910cdf20-276b-48e5-92e1-10fd32216ee2 to 31f9e22d-5e66-4a42-8991-4543819cab15. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Creating volume glance metadata for volume 31f9e22d-5e66-4a42-8991-4543819cab15 backed by image 910cdf20-276b-48e5-92e1-10fd32216ee2 with: {'image_id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cfba5919b73536212aad1c4fc6191cfa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e2a2aa-3c4e-4a24-8c2b-dfa2fe0a6789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01891ba1-c261-4c9a-bed4-efbf340cf740', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:00 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 1073741824 Sep 28 05:23:00 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c49849d-3082-4a83-91da-38577336e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-01891ba1-c261-4c9a-bed4-efbf340cf740 (01891ba1-c261-4c9a-bed4-efbf340cf740): created successfully Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c49849d-3082-4a83-91da-38577336e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:00 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (217ebdab-c44e-454f-b73e-cb149149362c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:00 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:00 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f59a62b0-0a09-476f-a4b5-1107cac50d6a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] 8d6fee1c-9005-432e-a5ae-05d582879106 was raw, converting to qcow2 {{(pid=86815) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:01 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa Sep 28 05:23:01 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:01 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa39de63-5012-43a8-a29a-4252c3663684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f9e22d-5e66-4a42-8991-4543819cab15', 'volume_size': 1, 'image_id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/910cdf20-276b-48e5-92e1-10fd32216ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfba5919b73536212aad1c4fc6191cfa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0c3473e0c554ad88c197fdc43039052', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af6a5566954e59121dd0d5c1678be02353f290a87f68a8fb125d8c4fc81505a3bc8d2f0bb85c91593ad1b6422701c460b9a5c58f28b6cdc9e1ee784e044bda03', 'id': '910cdf20-276b-48e5-92e1-10fd32216ee2', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/910cdf20-276b-48e5-92e1-10fd32216ee2/file', 'properties': {}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a6ba1c-741d-4476-9c6f-4d989a1e7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.384s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Volume volume-31f9e22d-5e66-4a42-8991-4543819cab15 (31f9e22d-5e66-4a42-8991-4543819cab15): created successfully Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a6ba1c-741d-4476-9c6f-4d989a1e7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Flow 'volume_create_manager' (4c4834cc-e0a4-40aa-b156-06f10a184661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bc18bed2-5499-4b24-83a5-3739ddc55663 tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-aa6ac66d-5ef3-471d-8b2a-22920defc5a5-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-507290ec-bfb2-4b6a-bfe6-de9d93a031d7 tempest-VolumeImageDependencyTests-5148266 None] Created volume successfully. Sep 28 05:23:01 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 1073741824" returned: 0 in 0.535s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Acquiring lock "cinder-31f9e22d-5e66-4a42-8991-4543819cab15-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "cinder-31f9e22d-5e66-4a42-8991-4543819cab15-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:01 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 Sep 28 05:23:01 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Acquiring lock "cinder-quobyte-31f9e22d-5e66-4a42-8991-4543819cab15" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "cinder-quobyte-31f9e22d-5e66-4a42-8991-4543819cab15" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:01 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa" returned: 0 in 0.578s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d6fee1c-9005-432e-a5ae-05d582879106_1n189o6vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb0055-a452-4031-808c-ae904c9f58d8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:01 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1G Sep 28 05:23:01 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:01 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 Sep 28 05:23:01 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:01 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76" returned: 0 in 0.299s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.199s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950668510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dae21d9-c06a-4458-8e4d-a8c126bdbd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:57Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 5dae21d9-c06a-4458-8e4d-a8c126bdbd62 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-43a7f121-32b1-452b-9ce6-b6838008c9f6-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:01 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 1073741824 Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3ec18-02a9-4336-abc6-18c99bc70b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:01 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e677f7c-c9f4-4469-813b-2595aa54b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-43a7f121-32b1-452b-9ce6-b6838008c9f6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 (9263e48e-e512-4a75-b8ce-8a9f32de1d76): created successfully Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e677f7c-c9f4-4469-813b-2595aa54b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (b4cb065c-5eff-4fc5-a9ac-55a214e9496d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-43a7f121-32b1-452b-9ce6-b6838008c9f6" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-76b2abce-b016-4520-b750-63ffeeae281a tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:23:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-43a7f121-32b1-452b-9ce6-b6838008c9f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc1ad5-184e-466a-8a5e-76cb1711bef3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa 1G" returned: 0 in 0.451s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Downloaded image 8d6fee1c-9005-432e-a5ae-05d582879106 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}])) to volume a7486180-5a5c-44a4-a3e6-459605dec2aa successfully. {{(pid=86815) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Temporary image 8d6fee1c-9005-432e-a5ae-05d582879106 for user 8f609f745ad64e83afe7bab31e54612c is deleted. {{(pid=86815) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.volume_utils [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Marking volume a7486180-5a5c-44a4-a3e6-459605dec2aa as bootable. {{(pid=86815) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Copying metadata from image 8d6fee1c-9005-432e-a5ae-05d582879106 to a7486180-5a5c-44a4-a3e6-459605dec2aa. {{(pid=86815) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Creating volume glance metadata for volume a7486180-5a5c-44a4-a3e6-459605dec2aa backed by image 8d6fee1c-9005-432e-a5ae-05d582879106 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dcaf854771fa9ae77153eb7ddbca9613', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86815) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 05:23:02 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15" returned: 0 in 0.501s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15 Sep 28 05:23:02 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849dc83-be29-4d05-8fa4-60b9363f43db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7486180-5a5c-44a4-a3e6-459605dec2aa', 'volume_size': 1, 'image_id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d6fee1c-9005-432e-a5ae-05d582879106', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dcaf854771fa9ae77153eb7ddbca9613', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ccd81d72a944832bf68de64311c58d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1309a240f2d1f854cb679fb4fabf799bbb3d978c9f7700b1d5006d2ddd10faf9f12d883d4d56b080b8d4645af051be57e493ee06a2098dbe920425f27f0c370', 'id': '8d6fee1c-9005-432e-a5ae-05d582879106', 'created_at': datetime.datetime(2026, 9, 28, 3, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 3, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d6fee1c-9005-432e-a5ae-05d582879106/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fa7ead-0296-44fb-87ad-f9fc4fb978f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:02 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Volume volume-a7486180-5a5c-44a4-a3e6-459605dec2aa (a7486180-5a5c-44a4-a3e6-459605dec2aa): created successfully Sep 28 05:23:02 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 Sep 28 05:23:02 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fa7ead-0296-44fb-87ad-f9fc4fb978f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Flow 'volume_create_manager' (76725165-b211-427e-b02c-bce68256e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-030b79e8-bf6e-44a9-8a3f-2212c61894c7 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Created volume successfully. Sep 28 05:23:02 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-31f9e22d-5e66-4a42-8991-4543819cab15" returned: 0 in 0.300s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "cinder-quobyte-31f9e22d-5e66-4a42-8991-4543819cab15" released by "delete_volume" :: held 0.858s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Acquiring lock "cinder-a7486180-5a5c-44a4-a3e6-459605dec2aa-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 1073741824" returned: 0 in 0.637s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "cinder-a7486180-5a5c-44a4-a3e6-459605dec2aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Acquiring lock "cinder-quobyte-a7486180-5a5c-44a4-a3e6-459605dec2aa" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:02 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Created reservations ['b62429da-9249-4fba-ba57-a8b05833ad1f', '6764eaf4-7b4b-44df-9dc2-b834a8c077ee', 'bddb5f2e-3406-4e97-a6b3-17f740eb3e74', 'e7bc58b0-dcb0-4a23-a401-02541060029b'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "cinder-quobyte-a7486180-5a5c-44a4-a3e6-459605dec2aa" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[342209db-efcc-4c15-9e33-b61e46ecd57c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6" returned: 0 in 0.624s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6 Sep 28 05:23:02 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:02 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa Sep 28 05:23:02 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.758s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065642940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e5926-c17d-45a1-8164-a63b9880420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159d343a51b942448cbe01deecd58b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:22:58Z,use_quota=True,user_id='07d3bdc6b7f84e95b0e62b6fa3feda84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Creating volume 3a1e5926-c17d-45a1-8164-a63b9880420a {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:02 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:02 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a 1073741824 Sep 28 05:23:02 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7ac9cd-a9f9-45bd-80f1-00b727a193b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d4e2f-e523-40a1-9f5c-368119f0dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:02 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 (5dae21d9-c06a-4458-8e4d-a8c126bdbd62): created successfully Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d4e2f-e523-40a1-9f5c-368119f0dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (13baa507-5075-4e47-bbdf-141d30b2d43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1f421858-0395-487b-8c08-f13c1aeb2f93 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:23:02 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-43a7f121-32b1-452b-9ce6-b6838008c9f6" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-43a7f121-32b1-452b-9ce6-b6838008c9f6" released by "delete_volume" :: held 1.011s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['d4981ced-a635-4768-a665-72dad38023ee', '63d65f8f-566a-4a03-83a9-56878c472a3c', '6b3ea95d-acb1-486e-abe9-42065909ac27', '0a6b6e91-61cf-4eb5-9182-a10add0ca20e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:03 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.384s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:03 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa" returned: 0 in 0.499s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Deleted volume successfully. Sep 28 05:23:03 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa Sep 28 05:23:03 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c4c4b5ef-4b01-4a1c-a2d6-5373fa8e7ddc tempest-VolumeImageDependencyTests-5148266 None] Lock "cinder-31f9e22d-5e66-4a42-8991-4543819cab15-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:03 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:03 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:03 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a 1073741824" returned: 0 in 0.523s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:03 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-a7486180-5a5c-44a4-a3e6-459605dec2aa" returned: 0 in 0.334s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a Sep 28 05:23:03 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:03 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "cinder-quobyte-a7486180-5a5c-44a4-a3e6-459605dec2aa" released by "delete_volume" :: held 0.910s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d3a2e292-6a09-4d73-aac1-dd0957ea8b2e tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-43a7f121-32b1-452b-9ce6-b6838008c9f6-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Created reservations ['7e58735e-81a9-4fc0-ab6f-42e8b26b8eda', '6a245d33-d881-4b96-9a2e-1c413efcb552', '25aaee44-3fbb-4931-8410-78ab46235df3', 'e0053822-dc4d-4bb4-b990-6a3713a43902'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:03 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:03 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:03 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a" returned: 0 in 0.281s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6a5325-6ad6-4245-9b11-128fd9f05ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1e5926-c17d-45a1-8164-a63b9880420a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb670711-25ee-4342-b534-47b142b717a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Volume volume-3a1e5926-c17d-45a1-8164-a63b9880420a (3a1e5926-c17d-45a1-8164-a63b9880420a): created successfully Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb670711-25ee-4342-b534-47b142b717a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Flow 'volume_create_manager' (910ba4e8-becf-4480-b6a8-bc6216bb7858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-61740444-bc78-4ca3-b9b1-afa25c612fed tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created volume successfully. Sep 28 05:23:03 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Deleted volume successfully. Sep 28 05:23:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9b909646-9d83-4de0-b8fb-f37b147792a6 tempest-VolumeAndVolumeTypeFromImageTest-1264229950 None] Lock "cinder-a7486180-5a5c-44a4-a3e6-459605dec2aa-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-0fe43c9d-6034-4e1a-8efc-f05041bdacbd-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-0fe43c9d-6034-4e1a-8efc-f05041bdacbd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09310f74-5ff8-4647-9c42-f76171d7e788]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:04 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd Sep 28 05:23:04 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-3a1e5926-c17d-45a1-8164-a63b9880420a-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-3a1e5926-c17d-45a1-8164-a63b9880420a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:04 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" returned: 0 in 0.450s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:04 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd Sep 28 05:23:04 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-3a1e5926-c17d-45a1-8164-a63b9880420a" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-3a1e5926-c17d-45a1-8164-a63b9880420a" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096d8b7-ace7-49aa-a7dc-e2fb383436f0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:05 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a Sep 28 05:23:05 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:05 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" returned: 0 in 0.392s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-0fe43c9d-6034-4e1a-8efc-f05041bdacbd" released by "delete_volume" :: held 0.911s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['63bd606f-ccf7-44e3-9cdc-ca22664ea8e7', 'f0778bdc-9e8a-479a-9941-1998a5378895', '3995bd0c-64fc-4a73-b9bf-1affb8504114', 'e8a2bd28-a5d1-408e-9172-49463a7987e8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:05 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:05 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-6207c5e0-6877-47e1-9073-fc017b6821c7-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-6207c5e0-6877-47e1-9073-fc017b6821c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:05 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a" returned: 0 in 0.568s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:05 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a Sep 28 05:23:05 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-6207c5e0-6877-47e1-9073-fc017b6821c7" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-6207c5e0-6877-47e1-9073-fc017b6821c7" acquired by "delete_volume" :: waited 0.033s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2280e0-953d-4fc4-bb2f-aea6f087f100]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:05 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 Sep 28 05:23:05 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:05 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.470s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-58a26f28-97eb-48dc-a57a-7dc3e6135f5b tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-0fe43c9d-6034-4e1a-8efc-f05041bdacbd-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:05 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-3a1e5926-c17d-45a1-8164-a63b9880420a" returned: 0 in 0.428s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-3a1e5926-c17d-45a1-8164-a63b9880420a" released by "delete_volume" :: held 1.064s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['a0beeec4-8d51-4243-95fb-81da526391af', '6157de1c-6543-4c86-a426-607ebc3d2856', '4598480c-db4d-433a-97e8-f703ce81a3d5', 'c2cf2178-22b2-46eb-9c05-161c0a29ae13'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:06 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:06 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:06 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7" returned: 0 in 0.513s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:06 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7 Sep 28 05:23:06 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:06 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.362s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-10cacb23-d4db-4029-b9d9-e114c0734740 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-3a1e5926-c17d-45a1-8164-a63b9880420a-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:06 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-6207c5e0-6877-47e1-9073-fc017b6821c7" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-6207c5e0-6877-47e1-9073-fc017b6821c7" released by "delete_volume" :: held 0.913s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['185ac44a-3d51-481e-bea7-d3ea929f3686', 'f2a1f618-1d3a-4121-893c-8d203f9330f8', 'fcc1bde9-ab37-4ea3-9f4f-93fa0c9970f6', '133b2965-fc84-4795-a656-25d7f3781b5c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:06 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:06 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:06 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.312s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:06 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-949cde52-e904-4cd6-a344-cb6daeba62bf tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-6207c5e0-6877-47e1-9073-fc017b6821c7-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:06 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-5dae21d9-c06a-4458-8e4d-a8c126bdbd62-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-5dae21d9-c06a-4458-8e4d-a8c126bdbd62-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c1515-f679-4cd6-a804-0061a2ef3c9a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:07 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 Sep 28 05:23:07 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:07 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" returned: 0 in 0.435s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:07 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62 Sep 28 05:23:07 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-97303b2b-e832-4ae1-a407-b60cd0e8f484-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-97303b2b-e832-4ae1-a407-b60cd0e8f484-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "cinder-quobyte-97303b2b-e832-4ae1-a407-b60cd0e8f484" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-97303b2b-e832-4ae1-a407-b60cd0e8f484" acquired by "delete_volume" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9ddf4-fa0a-4159-b22f-cb0d2bd93f6d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:07 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" returned: 0 in 0.423s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5dae21d9-c06a-4458-8e4d-a8c126bdbd62" released by "delete_volume" :: held 0.909s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['bcf95216-b9ec-47ef-8ca0-f25436d0e14e', '1285c417-d849-467c-bb97-7caabe63ec24', 'f672c5de-92f3-4301-84f3-ef465037e54d', '72ef5407-1044-4681-8a99-087b1e2572b1'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:08 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 Sep 28 05:23:08 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:08 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:08 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-9263e48e-e512-4a75-b8ce-8a9f32de1d76-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-9263e48e-e512-4a75-b8ce-8a9f32de1d76-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-9263e48e-e512-4a75-b8ce-8a9f32de1d76" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-9263e48e-e512-4a75-b8ce-8a9f32de1d76" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ab879a-9aad-477f-bcf6-a3405d549214]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:08 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484" returned: 0 in 0.648s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:08 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484 Sep 28 05:23:08 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:08 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 Sep 28 05:23:08 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:08 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.544s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:08 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-855a99be-55ab-4f9b-be3e-a3e671fcd878 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-5dae21d9-c06a-4458-8e4d-a8c126bdbd62-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:09 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-97303b2b-e832-4ae1-a407-b60cd0e8f484" returned: 0 in 0.493s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-quobyte-97303b2b-e832-4ae1-a407-b60cd0e8f484" released by "delete_volume" :: held 1.220s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:09 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76" returned: 0 in 0.660s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Created reservations ['836f3b9e-f251-454f-990f-d95c356a7644', 'b6c9d6c5-84d6-48ea-8492-66893bf522e9', 'edefd63c-6ab3-4304-92f3-932d24f03a9a', '9c38cb21-63ce-45e1-b071-4b786e8e70f0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:09 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76 Sep 28 05:23:09 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (6887e751-1aa9-4a73-9258-45b67dd439f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950bee9-c32d-4c5b-bd75-67b8e2856dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950bee9-c32d-4c5b-bd75-67b8e2856dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416588877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e24da2-39d9-4274-b707-3a87ac895cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:09Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acd1e55-9cca-4263-98fa-6d5815fbf3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acd1e55-9cca-4263-98fa-6d5815fbf3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25821dc-fe6a-442a-9d07-868be559556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25821dc-fe6a-442a-9d07-868be559556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e24da2-39d9-4274-b707-3a87ac895cba', 'volume_name': 'volume-e9e24da2-39d9-4274-b707-3a87ac895cba', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d0d6f6-6cc2-4909-93e4-019191874a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d0d6f6-6cc2-4909-93e4-019191874a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7145a4fc-4c2d-4f66-9d4a-e5a517a2258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Volume e9e24da2-39d9-4274-b707-3a87ac895cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e24da2-39d9-4274-b707-3a87ac895cba', 'volume_size': 1} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416588877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e24da2-39d9-4274-b707-3a87ac895cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:09Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Creating volume e9e24da2-39d9-4274-b707-3a87ac895cba {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:09 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:09 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba 1073741824 Sep 28 05:23:09 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:09 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:09 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:09 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-9263e48e-e512-4a75-b8ce-8a9f32de1d76" returned: 0 in 0.313s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-9263e48e-e512-4a75-b8ce-8a9f32de1d76" released by "delete_volume" :: held 1.052s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['d7eeb90a-8bb3-4f85-be1a-a42151f44245', 'ca9773ba-ad85-4965-8929-d9d8e1c7c658', '80eb290d-0fb2-4973-82e7-4071b8741a97', '931a91ef-9206-41fc-9ec1-2ebb09dca2ca'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:09 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:09 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Deleted volume successfully. Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-121b0493-337d-4c6a-a108-28e730dede8a tempest-CreateVolumesFromSourceVolumeTest-351865930 None] Lock "cinder-97303b2b-e832-4ae1-a407-b60cd0e8f484-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:09 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:09 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:09 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba 1073741824" returned: 0 in 0.615s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:10 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.325s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:10 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:10 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-188027d5-4a35-4cc0-89e1-080cb924a4d5 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-9263e48e-e512-4a75-b8ce-8a9f32de1d76-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:10 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba" returned: 0 in 0.345s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7145a4fc-4c2d-4f66-9d4a-e5a517a2258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e24da2-39d9-4274-b707-3a87ac895cba', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c52cb3-0da8-4494-aba9-84bb2ee0bc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Volume volume-e9e24da2-39d9-4274-b707-3a87ac895cba (e9e24da2-39d9-4274-b707-3a87ac895cba): created successfully Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c52cb3-0da8-4494-aba9-84bb2ee0bc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (6887e751-1aa9-4a73-9258-45b67dd439f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0866dcc5-fc92-4e45-8e14-9d58339a5cbc tempest-ProjectReaderTests-1910966125 None] Created volume successfully. Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-01891ba1-c261-4c9a-bed4-efbf340cf740-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-01891ba1-c261-4c9a-bed4-efbf340cf740-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-01891ba1-c261-4c9a-bed4-efbf340cf740" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-01891ba1-c261-4c9a-bed4-efbf340cf740" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2056f8-01d0-4184-a10e-45ba6445d644]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:10 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 Sep 28 05:23:10 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (cc1d4588-7040-4ef2-9621-027349ff43f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e61085-4e6f-4e11-bc38-3509fcfa151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e61085-4e6f-4e11-bc38-3509fcfa151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1309470482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:11Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7a2949-286b-48b5-9957-b9e04e18fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7a2949-286b-48b5-9957-b9e04e18fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b98ab-a276-4fc7-b522-e5efe20dfa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b98ab-a276-4fc7-b522-e5efe20dfa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315', 'volume_name': 'volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1b018a-e4a5-4828-b072-b12827a84cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1b018a-e4a5-4828-b072-b12827a84cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e922e2-41a5-4ca2-824a-49405bf37127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Volume 1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315', 'volume_size': 1} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1309470482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:11Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Creating volume 1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:11 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:11 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 1073741824 Sep 28 05:23:11 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:11 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740" returned: 0 in 0.573s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:11 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740 Sep 28 05:23:11 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (0ab0498a-1716-4b95-a53c-6f836d754452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b1e7e-0c7e-4dff-89ec-b293984e14a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b1e7e-0c7e-4dff-89ec-b293984e14a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545436053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4b2f59-575e-4951-ba8a-3f6238780831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:11Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842c5758-4982-4127-8502-782a932d629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842c5758-4982-4127-8502-782a932d629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0914ea-7d6c-4212-81ec-a4902a9ec079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0914ea-7d6c-4212-81ec-a4902a9ec079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c4b2f59-575e-4951-ba8a-3f6238780831', 'volume_name': 'volume-4c4b2f59-575e-4951-ba8a-3f6238780831', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460b4c0c-57c9-4ab0-952a-fcb2d982c4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460b4c0c-57c9-4ab0-952a-fcb2d982c4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d223168-4b84-4722-ab42-cb065141c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:11 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Volume 4c4b2f59-575e-4951-ba8a-3f6238780831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c4b2f59-575e-4951-ba8a-3f6238780831', 'volume_size': 1} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:11 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-01891ba1-c261-4c9a-bed4-efbf340cf740" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-01891ba1-c261-4c9a-bed4-efbf340cf740" released by "delete_volume" :: held 0.988s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['35d9f1fa-1c99-4f88-88b8-d0c11d86fc62', 'c18c2cc9-5dd3-47d3-83e2-7d20d1a228c5', 'd96b5d04-4805-4dd1-94bd-8d58ef80c5cd', '84d9358f-4bb2-4c53-8e0e-13963ad071ba'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:11 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 1073741824" returned: 0 in 0.900s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:12 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 Sep 28 05:23:12 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-e9e24da2-39d9-4274-b707-3a87ac895cba-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:12 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:12 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-e9e24da2-39d9-4274-b707-3a87ac895cba-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (7da6e0d6-6c0c-4f0a-a452-148d0cd9ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c91e6-85d5-4921-bc96-f2eebed16986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-quobyte-e9e24da2-39d9-4274-b707-3a87ac895cba" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c91e6-85d5-4921-bc96-f2eebed16986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148305380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503773dc-1892-4076-b72c-bb20656dc61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:12Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c94717-850f-4777-8717-2494621c7e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c94717-850f-4777-8717-2494621c7e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b04b34-b904-484c-aa0e-1e9a1ea41f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b04b34-b904-484c-aa0e-1e9a1ea41f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503773dc-1892-4076-b72c-bb20656dc61d', 'volume_name': 'volume-503773dc-1892-4076-b72c-bb20656dc61d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d0f2c-2457-4d88-bea0-a8e892eee816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d0f2c-2457-4d88-bea0-a8e892eee816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60762593-776f-45ea-a606-67e4307cf25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Volume 503773dc-1892-4076-b72c-bb20656dc61d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503773dc-1892-4076-b72c-bb20656dc61d', 'volume_size': 1} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-e9e24da2-39d9-4274-b707-3a87ac895cba" acquired by "delete_volume" :: waited 0.087s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:12 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ce6e9-8660-4b8e-9e4d-4127a50ced1c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" acquired by "delete_volume" :: waited 0.077s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:12 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" returned: 0 in 0.553s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545436053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c4b2f59-575e-4951-ba8a-3f6238780831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:11Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Creating volume 4c4b2f59-575e-4951-ba8a-3f6238780831 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:12 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db60903-cbdd-416c-9e13-dca7ae2bbf86]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c8ea9465-1585-4522-809c-932e923ea65c tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-01891ba1-c261-4c9a-bed4-efbf340cf740-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:12 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba Sep 28 05:23:12 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:12 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 1073741824 Sep 28 05:23:12 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e922e2-41a5-4ca2-824a-49405bf37127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6603fc-1608-476f-992f-10aacc3fd856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:12 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Volume volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 (1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315): created successfully Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6603fc-1608-476f-992f-10aacc3fd856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (cc1d4588-7040-4ef2-9621-027349ff43f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-71bde17b-92b7-42f3-b1de-cca920dc886b tempest-CreateVolumesFromImageTest-296346313 None] Created volume successfully. Sep 28 05:23:12 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 Sep 28 05:23:12 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:12 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (51979751-9be6-4835-a1d2-cd1dfdf8ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44fa338-fc7b-4478-ae2d-536f445cd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44fa338-fc7b-4478-ae2d-536f445cd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856201412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fc74d3-1917-41ed-acf7-cf49f7f0f817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:13Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff5578d-2cb7-44cd-8ca3-2503f9d3a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff5578d-2cb7-44cd-8ca3-2503f9d3a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9388007c-96f3-4383-8e73-aec52b6411aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9388007c-96f3-4383-8e73-aec52b6411aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fc74d3-1917-41ed-acf7-cf49f7f0f817', 'volume_name': 'volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd72dd-255b-4652-8dfc-dbe13fd7ccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd72dd-255b-4652-8dfc-dbe13fd7ccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f856bf7c-32f9-497d-b402-d3446171ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Volume 57fc74d3-1917-41ed-acf7-cf49f7f0f817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817', 'volume_size': 1} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:13 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba" returned: 0 in 0.698s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:13 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba Sep 28 05:23:13 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:13 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 1073741824" returned: 0 in 0.857s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" returned: 0 in 0.841s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:13 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9 Sep 28 05:23:13 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:13 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 Sep 28 05:23:13 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (86d629c0-5a69-4397-a018-c2c6063b4d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2b787c-3a85-4124-b47d-1336b4e680fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e9e24da2-39d9-4274-b707-3a87ac895cba" returned: 0 in 0.457s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2b787c-3a85-4124-b47d-1336b4e680fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685621649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dd7597-861b-4ff8-b7b2-f24a12670c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:13Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb01600-52ea-40a2-be42-17f043238460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb01600-52ea-40a2-be42-17f043238460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfcd97d-3213-4175-bbdd-83a4ae90f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfcd97d-3213-4175-bbdd-83a4ae90f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82dd7597-861b-4ff8-b7b2-f24a12670c61', 'volume_name': 'volume-82dd7597-861b-4ff8-b7b2-f24a12670c61', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e138f862-7a01-4376-a5d4-ee26c2407300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e138f862-7a01-4376-a5d4-ee26c2407300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49913e5-4ac7-4112-97cc-0b6ba003c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Volume 82dd7597-861b-4ff8-b7b2-f24a12670c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82dd7597-861b-4ff8-b7b2-f24a12670c61', 'volume_size': 1} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-e9e24da2-39d9-4274-b707-3a87ac895cba" released by "delete_volume" :: held 1.260s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Created reservations ['026c0ccc-a13f-4cd9-b460-2543a4f9b53b', '5b616500-ef1c-4bb5-bd4b-d36b2c5c4499', '7195e7a6-a9ea-47cc-9583-f4fcc1321555', '90032093-5b3b-4490-97b1-8c2923e788b9'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:13 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" returned: 0 in 0.338s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9" released by "delete_volume" :: held 1.320s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:13 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:13 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:13 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831" returned: 0 in 0.338s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148305380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503773dc-1892-4076-b72c-bb20656dc61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:12Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Creating volume 503773dc-1892-4076-b72c-bb20656dc61d {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:13 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d223168-4b84-4722-ab42-cb065141c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c4b2f59-575e-4951-ba8a-3f6238780831', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d 1073741824 Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095058d-ef64-481f-8648-d1e4e26f5d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:13 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Volume volume-4c4b2f59-575e-4951-ba8a-3f6238780831 (4c4b2f59-575e-4951-ba8a-3f6238780831): created successfully Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095058d-ef64-481f-8648-d1e4e26f5d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (0ab0498a-1716-4b95-a53c-6f836d754452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-14b45d0b-f534-413e-a7b7-f1a043514125 tempest-CreateVolumesFromImageTest-296346313 None] Created volume successfully. Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['f6d86cba-daee-42a2-addd-986f2fd55e76', '06a11acb-7429-444a-a874-d90f062f1e5e', '7abcf01d-497b-49da-9596-ea9f37b96f67', 'b1dc9122-378c-4df3-976a-c9ef23aba2f5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:14 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.310s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:14 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:14 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Deleted volume successfully. Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-d264fdb5-b5ac-4e89-9149-c54bd063e403 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-e9e24da2-39d9-4274-b707-3a87ac895cba-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:14 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.333s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:14 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d 1073741824" returned: 0 in 0.562s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0ec52c4c-535f-4037-b875-a6ab5df85ca9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-8f18daa7-0317-46e4-a3e8-2acbbadfd9b9-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:14 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d Sep 28 05:23:14 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-14658c3b-a579-4574-b1e9-0a875a67a6fb-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Flow 'volume_create_manager' (e3c2e98e-d3df-4994-8fe0-98cb9b471228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705f4aef-9402-4885-89dc-9e0a39d4acfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-14658c3b-a579-4574-b1e9-0a875a67a6fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705f4aef-9402-4885-89dc-9e0a39d4acfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7efda8-57cc-438b-9e80-3acfaecd00e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2799405a7444b59162bb1ecb11f174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:15Z,use_quota=True,user_id='0f5391fe671f436a89dff70526dfdbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b2e378-5e74-4064-a149-14e67faea7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b2e378-5e74-4064-a149-14e67faea7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce00879-f753-4972-988a-77c754d31f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce00879-f753-4972-988a-77c754d31f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7efda8-57cc-438b-9e80-3acfaecd00e2', 'volume_name': 'volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592e1efc-7709-445b-9b1d-691d9ee68523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592e1efc-7709-445b-9b1d-691d9ee68523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8cca48-9513-4ce6-934c-65ec8d74d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Volume cb7efda8-57cc-438b-9e80-3acfaecd00e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2', 'volume_size': 1} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" acquired by "delete_snapshot" :: waited 0.109s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-14658c3b-a579-4574-b1e9-0a875a67a6fb" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-14658c3b-a579-4574-b1e9-0a875a67a6fb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleting offline snapshot 14658c3b-a579-4574-b1e9-0a875a67a6fb of volume 5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] snapshot_file for this snap is: volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:23:14 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28684651-769b-4528-a735-312c4e90fcf9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856201412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fc74d3-1917-41ed-acf7-cf49f7f0f817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:13Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Creating volume 57fc74d3-1917-41ed-acf7-cf49f7f0f817 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:14 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60762593-776f-45ea-a606-67e4307cf25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503773dc-1892-4076-b72c-bb20656dc61d', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:14 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb18dbff-fa59-4e2c-9124-d65a2cf9c23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:14 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 1073741824 Sep 28 05:23:15 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Volume volume-503773dc-1892-4076-b72c-bb20656dc61d (503773dc-1892-4076-b72c-bb20656dc61d): created successfully Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb18dbff-fa59-4e2c-9124-d65a2cf9c23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (7da6e0d6-6c0c-4f0a-a452-148d0cd9ba47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:15 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb Sep 28 05:23:15 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-76e10d0d-3733-473a-a898-5cc1f7609c36 tempest-CreateVolumesFromImageTest-296346313 None] Created volume successfully. Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (8d325a5d-f4cb-4dfa-897b-328a27d03e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4380b55-ee43-4aa9-b3a5-acc4b59fc080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4380b55-ee43-4aa9-b3a5-acc4b59fc080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552824008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65245a-4a10-4fab-a23b-7655577f6e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:15Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837b393d-f8e8-4584-8498-a2499d75f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837b393d-f8e8-4584-8498-a2499d75f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c4d07-0f26-44e0-b7ad-2c5f21eb784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c4d07-0f26-44e0-b7ad-2c5f21eb784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af65245a-4a10-4fab-a23b-7655577f6e41', 'volume_name': 'volume-af65245a-4a10-4fab-a23b-7655577f6e41', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4f4909-f771-4862-9c40-b0e6efadc053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4f4909-f771-4862-9c40-b0e6efadc053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8d0884-cb05-4bbf-b9b2-1d2c9d58ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Volume af65245a-4a10-4fab-a23b-7655577f6e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af65245a-4a10-4fab-a23b-7655577f6e41', 'volume_size': 1} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:15 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb" returned: 0 in 0.396s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c63a793-265e-435c-872f-46d01cc04f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7492a9-ffe3-474e-b845-e6e3f00856eb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:15 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 1073741824" returned: 0 in 0.471s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:15 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 Sep 28 05:23:15 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 Sep 28 05:23:15 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685621649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dd7597-861b-4ff8-b7b2-f24a12670c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea638f126a9f43d3993d5b9c68f562f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:13Z,use_quota=True,user_id='aeb5bf98893f46478d82d16ed4393dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Creating volume 82dd7597-861b-4ff8-b7b2-f24a12670c61 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:15 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15" returned: 0 in 0.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:15 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 1073741824 Sep 28 05:23:15 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f856bf7c-32f9-497d-b402-d3446171ceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27566334-e89d-47dd-8e13-9c35ce464f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Volume volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 (57fc74d3-1917-41ed-acf7-cf49f7f0f817): created successfully Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27566334-e89d-47dd-8e13-9c35ce464f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:15 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (51979751-9be6-4835-a1d2-cd1dfdf8ea42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-51d84385-7b25-43db-b7be-70c75de37a8a tempest-CreateVolumesFromImageTest-296346313 None] Created volume successfully. Sep 28 05:23:16 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb" returned: 0 in 0.402s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:16 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb Sep 28 05:23:16 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:16 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 1073741824" returned: 0 in 0.482s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:16 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 Sep 28 05:23:16 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:16 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15.14658c3b-a579-4574-b1e9-0a875a67a6fb" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-14658c3b-a579-4574-b1e9-0a875a67a6fb" released by "_delete_snapshot" :: held 1.598s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" released by "delete_snapshot" :: held 1.630s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:16 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7efda8-57cc-438b-9e80-3acfaecd00e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2799405a7444b59162bb1ecb11f174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:15Z,use_quota=True,user_id='0f5391fe671f436a89dff70526dfdbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Creating volume cb7efda8-57cc-438b-9e80-3acfaecd00e2 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:16 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['db56d736-ec41-493e-a8b5-2b2fb4549190', 'feac4faa-3f6c-4db7-8ef5-f8cb904fa446', '71523ec9-2299-46f8-b6d2-f58641ba5f08', 'f4ff55dc-6fa1-4d66-8c0e-893ea8bba8bf'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:16 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 1073741824 Sep 28 05:23:16 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49913e5-4ac7-4112-97cc-0b6ba003c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82dd7597-861b-4ff8-b7b2-f24a12670c61', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7bb7f-6f8b-45bc-941d-aa5abedfa487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:16 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Volume volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 (82dd7597-861b-4ff8-b7b2-f24a12670c61): created successfully Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7bb7f-6f8b-45bc-941d-aa5abedfa487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Flow 'volume_create_manager' (86d629c0-5a69-4397-a018-c2c6063b4d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-e7e30286-0947-425a-824e-01d066ff9e41 tempest-CreateVolumesFromImageTest-296346313 None] Created volume successfully. Sep 28 05:23:16 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Delete snapshot completed successfully. Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-40f9113c-4a27-4ec6-aa10-0e8fa8fbfa73 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-14658c3b-a579-4574-b1e9-0a875a67a6fb-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-5c63a793-265e-435c-872f-46d01cc04f15-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-5c63a793-265e-435c-872f-46d01cc04f15-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:16 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970e2f7-37ef-4ed4-bb75-068c3cd2e4a8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 1073741824" returned: 0 in 0.548s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-82dd7597-861b-4ff8-b7b2-f24a12670c61-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-82dd7597-861b-4ff8-b7b2-f24a12670c61-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:17 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-quobyte-82dd7597-861b-4ff8-b7b2-f24a12670c61" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:17 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-82dd7597-861b-4ff8-b7b2-f24a12670c61" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d902ed-9ff2-45b2-976b-19df262b5698]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 Sep 28 05:23:17 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2" returned: 0 in 0.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:17 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552824008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65245a-4a10-4fab-a23b-7655577f6e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:15Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Creating volume af65245a-4a10-4fab-a23b-7655577f6e41 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:17 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15" returned: 0 in 0.424s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 1073741824 Sep 28 05:23:17 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8cca48-9513-4ce6-934c-65ec8d74d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbe4f0d-b325-4528-804d-4b0791422b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:17 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15 Sep 28 05:23:17 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Volume volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 (cb7efda8-57cc-438b-9e80-3acfaecd00e2): created successfully Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbe4f0d-b325-4528-804d-4b0791422b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Flow 'volume_create_manager' (e3c2e98e-d3df-4994-8fe0-98cb9b471228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1cf0f7e2-f54b-4dd7-8d47-518ad1903f0e tempest-CinderUnicodeTest-1356556116 None] Created volume successfully. Sep 28 05:23:17 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61 Sep 28 05:23:17 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-5c63a793-265e-435c-872f-46d01cc04f15" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-quobyte-5c63a793-265e-435c-872f-46d01cc04f15" released by "delete_volume" :: held 0.819s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Created reservations ['8ad618dd-4bac-44ae-af91-6883eb42391d', 'b521757f-8087-453c-b0c0-37b6a24b578e', 'aeb6e8bd-df01-4d2e-8a2d-6a1d62e6efaa', '4efd1395-0ae6-46bd-8011-ed74711e1734'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:17 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:17 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:17 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 1073741824" returned: 0 in 0.543s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-82dd7597-861b-4ff8-b7b2-f24a12670c61" returned: 0 in 0.348s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-82dd7597-861b-4ff8-b7b2-f24a12670c61" released by "delete_volume" :: held 0.819s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:18 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 Sep 28 05:23:18 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Created reservations ['6868a490-8598-4bae-8c65-9ebc30c3a90c', 'd7d13804-31ae-4bf5-be4c-9bcffd384d7a', '02daf128-ab7d-4a0b-ac4d-c54185ab0bd4', 'f207756b-3757-4521-978d-0d8600f3df64'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:18 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:18 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.418s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:18 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Deleted volume successfully. Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-57fc74d3-1917-41ed-acf7-cf49f7f0f817-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-57fc74d3-1917-41ed-acf7-cf49f7f0f817-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-464a86e2-d9d1-45da-a90e-f395a76173e9 tempest-CreateVolumesFromSnapshotTest-1405529433 None] Lock "cinder-5c63a793-265e-435c-872f-46d01cc04f15-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-quobyte-57fc74d3-1917-41ed-acf7-cf49f7f0f817" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-57fc74d3-1917-41ed-acf7-cf49f7f0f817" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f088fad7-1191-411f-a3d3-e671f9128c2d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:18 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41" returned: 0 in 0.486s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Flow 'volume_create_manager' (b1c6e068-3263-4a8f-88b8-6d924fd572d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90783ce1-bc14-4908-94e3-4b49d0b78d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90783ce1-bc14-4908-94e3-4b49d0b78d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2028879705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f507723a-fd52-4df0-b374-be7d2fa38e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2799405a7444b59162bb1ecb11f174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:18Z,use_quota=True,user_id='0f5391fe671f436a89dff70526dfdbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38285616-91c6-4ea3-8687-031f04a56da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38285616-91c6-4ea3-8687-031f04a56da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eabfa28-42c6-45aa-9e4e-ba410fa5dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eabfa28-42c6-45aa-9e4e-ba410fa5dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f507723a-fd52-4df0-b374-be7d2fa38e51', 'volume_name': 'volume-f507723a-fd52-4df0-b374-be7d2fa38e51', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5643ee-07a8-4f75-8790-a72387ad7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5643ee-07a8-4f75-8790-a72387ad7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e5ea64-ee2b-480f-821f-791e348b196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Volume f507723a-fd52-4df0-b374-be7d2fa38e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f507723a-fd52-4df0-b374-be7d2fa38e51', 'volume_size': 1} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:18 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 Sep 28 05:23:18 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2028879705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f507723a-fd52-4df0-b374-be7d2fa38e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2799405a7444b59162bb1ecb11f174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:18Z,use_quota=True,user_id='0f5391fe671f436a89dff70526dfdbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Creating volume f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8d0884-cb05-4bbf-b9b2-1d2c9d58ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af65245a-4a10-4fab-a23b-7655577f6e41', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bb0559-9e20-499e-9009-49c91c9d8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:18 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:18 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 1073741824 Sep 28 05:23:18 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.459s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Volume volume-af65245a-4a10-4fab-a23b-7655577f6e41 (af65245a-4a10-4fab-a23b-7655577f6e41): created successfully Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bb0559-9e20-499e-9009-49c91c9d8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (8d325a5d-f4cb-4dfa-897b-328a27d03e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Deleted volume successfully. Sep 28 05:23:18 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-eda16eba-83a7-4cc1-9862-47da2d6affb5 tempest-ProjectReaderTests-1910966125 None] Created volume successfully. Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7ccfc60d-711d-426a-95ab-585bad6f073f tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-82dd7597-861b-4ff8-b7b2-f24a12670c61-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:18 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817" returned: 0 in 0.450s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:19 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817 Sep 28 05:23:19 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:19 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-57fc74d3-1917-41ed-acf7-cf49f7f0f817" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:19 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-57fc74d3-1917-41ed-acf7-cf49f7f0f817" released by "delete_volume" :: held 0.805s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 1073741824" returned: 0 in 0.618s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:19 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 Sep 28 05:23:19 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Created reservations ['ad4cc1ff-b5ea-45d5-bc2b-f996f4eefe0b', '63c5fe54-fefe-4794-bf72-aa65fd027cb0', '3901a873-f33b-4009-bfed-f5f8329337c8', '44cc206e-73c1-4766-9be4-fef5cf775f87'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-af65245a-4a10-4fab-a23b-7655577f6e41-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "cinder-af65245a-4a10-4fab-a23b-7655577f6e41-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-quobyte-af65245a-4a10-4fab-a23b-7655577f6e41" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-af65245a-4a10-4fab-a23b-7655577f6e41" acquired by "delete_volume" :: waited 0.050s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:19 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:19 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-503773dc-1892-4076-b72c-bb20656dc61d-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c8b248-db2a-48c0-870b-605356483803]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-503773dc-1892-4076-b72c-bb20656dc61d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-quobyte-503773dc-1892-4076-b72c-bb20656dc61d" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:19 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51" returned: 0 in 0.429s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-503773dc-1892-4076-b72c-bb20656dc61d" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26ebf9-217b-47f6-9deb-6752905d5055]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:19 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 Sep 28 05:23:19 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e5ea64-ee2b-480f-821f-791e348b196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f507723a-fd52-4df0-b374-be7d2fa38e51', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ba066-6d66-451b-b025-79a2a1e0872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:19 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Volume volume-f507723a-fd52-4df0-b374-be7d2fa38e51 (f507723a-fd52-4df0-b374-be7d2fa38e51): created successfully Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ba066-6d66-451b-b025-79a2a1e0872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Flow 'volume_create_manager' (b1c6e068-3263-4a8f-88b8-6d924fd572d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-58111c00-c1f7-4961-8d3d-319c6236027a tempest-CinderUnicodeTest-1356556116 None] Created volume successfully. Sep 28 05:23:19 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d Sep 28 05:23:19 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:19 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.430s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:19 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Deleted volume successfully. Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8ace5a9c-4d9f-4a0d-9b4e-f4890bb02d7d tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-57fc74d3-1917-41ed-acf7-cf49f7f0f817-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:20 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41" returned: 0 in 0.545s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:20 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41 Sep 28 05:23:20 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:20 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:20 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d Sep 28 05:23:20 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:20 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-af65245a-4a10-4fab-a23b-7655577f6e41" returned: 0 in 0.280s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-af65245a-4a10-4fab-a23b-7655577f6e41" released by "delete_volume" :: held 0.908s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Created reservations ['8bf07300-2e9c-4fcd-9af8-00f47d84d456', '7a04b342-9f6f-4b41-9e67-f3af4388ebad', '393f41d0-69b3-4602-bb53-b67f397194d6', 'a422428b-525f-43bd-a5a4-9e6690a5e827'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:20 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-503773dc-1892-4076-b72c-bb20656dc61d" returned: 0 in 0.316s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-503773dc-1892-4076-b72c-bb20656dc61d" released by "delete_volume" :: held 0.841s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:20 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:20 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Created reservations ['4af3df9b-3932-4b90-89ff-5058dbaf0250', '7d0ce949-c09c-4236-b205-d42078d1c3a4', 'e8b94461-83b5-4b88-87d0-4d1f3f4a3419', 'b3a444dc-70d5-4daa-8e60-3d071859166e'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-4c4b2f59-575e-4951-ba8a-3f6238780831-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-4c4b2f59-575e-4951-ba8a-3f6238780831-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:20 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:20 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:21 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.365s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-quobyte-4c4b2f59-575e-4951-ba8a-3f6238780831" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Deleted volume successfully. Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-4c4b2f59-575e-4951-ba8a-3f6238780831" acquired by "delete_volume" :: waited 0.037s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-854fb936-2836-4013-b752-184588f57ffa tempest-ProjectReaderTests-1910966125 None] Lock "cinder-af65245a-4a10-4fab-a23b-7655577f6e41-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Creating offline snapshot 1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 of volume f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[118720b7-7a1b-4d91-8b3e-339bd7cf3309]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e7965f-575e-442c-9443-b9a455f35f9e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:21 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.345s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:21 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 Sep 28 05:23:21 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Deleted volume successfully. Sep 28 05:23:21 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 Sep 28 05:23:21 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f737de3c-fae2-4988-a791-00329d402eda tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-503773dc-1892-4076-b72c-bb20656dc61d-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:21 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831" returned: 0 in 0.423s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:21 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51" returned: 0 in 0.417s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:21 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831 Sep 28 05:23:21 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:21 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 1G Sep 28 05:23:21 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:21 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c4b2f59-575e-4951-ba8a-3f6238780831" returned: 0 in 0.350s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-4c4b2f59-575e-4951-ba8a-3f6238780831" released by "delete_volume" :: held 0.844s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:21 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Created reservations ['e39e59aa-daa3-42ae-a399-3cd4fadbab29', 'befc7840-b75b-4dca-8a39-634f6993cefa', '9bc524db-995d-493c-99f3-73efae2cd74c', '68377b3e-0f40-43bb-ad16-a299ce96d095'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Flow 'volume_create_manager' (7955ef07-add5-4438-9bd4-e1c9ed040693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d0d20e-765e-42bd-928c-d133f6ad379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d0d20e-765e-42bd-928c-d133f6ad379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1482980267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476306a6-7109-4617-aefe-16a4238bb6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e5ee5943304a89b85726c36ec95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:22Z,use_quota=True,user_id='7dfcef9da3484950b3a695ad509ed6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aeb4fd-6f0b-45cc-9995-73bf73450257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3aeb4fd-6f0b-45cc-9995-73bf73450257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032c5185-3e35-474a-b6ea-8d7d034d1cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032c5185-3e35-474a-b6ea-8d7d034d1cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476306a6-7109-4617-aefe-16a4238bb6f5', 'volume_name': 'volume-476306a6-7109-4617-aefe-16a4238bb6f5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3c7b4e-d90c-4912-be93-844eae843d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3c7b4e-d90c-4912-be93-844eae843d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d70c042-441a-4f6d-aaec-b619afd9b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Volume 476306a6-7109-4617-aefe-16a4238bb6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476306a6-7109-4617-aefe-16a4238bb6f5', 'volume_size': 1} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:22 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 1G" returned: 0 in 0.677s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f507723a-fd52-4df0-b374-be7d2fa38e51 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f507723a-fd52-4df0-b374-be7d2fa38e51 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 Sep 28 05:23:22 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:22 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:22 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "cinder-quobyte-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc464516-7fa2-442a-8883-65b5cb72e255]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (19ad819a-dd0e-4f99-9bed-78c546a70eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8151c76a-d2de-4dda-baf2-0f319e45f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8151c76a-d2de-4dda-baf2-0f319e45f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974321810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec4e30b-4215-4570-92ae-3f309cf021af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:22Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b062f14-c404-4bdb-a790-d5085bb270a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b062f14-c404-4bdb-a790-d5085bb270a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043f2f1b-834d-4229-8195-a1f912e5bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043f2f1b-834d-4229-8195-a1f912e5bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec4e30b-4215-4570-92ae-3f309cf021af', 'volume_name': 'volume-eec4e30b-4215-4570-92ae-3f309cf021af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0530b611-5a5c-4d7e-91af-235918cbebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0530b611-5a5c-4d7e-91af-235918cbebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f537950b-9a42-4906-ad5a-32ecbc227ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:22 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Volume eec4e30b-4215-4570-92ae-3f309cf021af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec4e30b-4215-4570-92ae-3f309cf021af', 'volume_size': 1} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:22 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 Sep 28 05:23:22 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:22 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.290s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:22 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Deleted volume successfully. Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4accc502-3c84-4be8-a0c6-9a6f7e1fec82 tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-4c4b2f59-575e-4951-ba8a-3f6238780831-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:22 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f507723a-fd52-4df0-b374-be7d2fa38e51 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" returned: 0 in 0.371s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:22 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 is being set with open permissions: ugo+rw Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 Sep 28 05:23:22 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:22 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" returned: 0 in 0.401s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315 Sep 28 05:23:22 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:22 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" returned: 0 in 0.271s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:22 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info Sep 28 05:23:22 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:23 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" returned: 0 in 0.261s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-quobyte-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315" released by "delete_volume" :: held 0.726s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Created reservations ['835cdfa4-b9ab-491b-85fa-9f2bd2609e0c', 'ea52bd02-eb11-4c3f-bc4f-f3ee5e37f3f5', 'ec970199-919d-403b-a79a-23e67ff80741', 'ccafe3b9-69dd-4a23-b8fe-d1d6d6608432'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:23 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:23 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info is being set with open permissions: ugo+rw Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:23 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info Sep 28 05:23:23 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:23 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:23 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:23 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.info" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:23 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1482980267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476306a6-7109-4617-aefe-16a4238bb6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e5ee5943304a89b85726c36ec95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:22Z,use_quota=True,user_id='7dfcef9da3484950b3a695ad509ed6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Creating volume 476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:23 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:23 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 1073741824 Sep 28 05:23:23 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Deleted volume successfully. Sep 28 05:23:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1e3bb24c-516c-4caa-a5a6-d398dc2db992 tempest-CinderUnicodeTest-1356556116 None] Create snapshot completed successfully Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-03dd96f4-8650-4b3d-be90-f4b8c349672e tempest-CreateVolumesFromImageTest-296346313 None] Lock "cinder-1a1bfe36-85ff-4a6e-a7f7-ee9831f2a315-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:23 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 1073741824" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:24 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:24 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-quobyte-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:24 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.312s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974321810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec4e30b-4215-4570-92ae-3f309cf021af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:22Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Creating volume eec4e30b-4215-4570-92ae-3f309cf021af {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:24 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d70c042-441a-4f6d-aaec-b619afd9b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476306a6-7109-4617-aefe-16a4238bb6f5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ce8d17-ad7f-442d-93fa-03cbe867456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:24 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af 1073741824 Sep 28 05:23:24 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Deleting offline snapshot 1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 of volume f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] snapshot_file for this snap is: volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:23:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Volume volume-476306a6-7109-4617-aefe-16a4238bb6f5 (476306a6-7109-4617-aefe-16a4238bb6f5): created successfully Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ce8d17-ad7f-442d-93fa-03cbe867456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Flow 'volume_create_manager' (7955ef07-add5-4438-9bd4-e1c9ed040693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359ad04-e6a5-4dcd-8216-338779f284fc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c0e9ad80-ee34-481e-a22d-c0d971d123d8 tempest-VolumeDependencyTests-637097824 None] Created volume successfully. Sep 28 05:23:24 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 Sep 28 05:23:24 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:24 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af 1073741824" returned: 0 in 0.560s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:24 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" returned: 0 in 0.472s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f507723a-fd52-4df0-b374-be7d2fa38e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb0dc25-c53f-46f0-8ab9-9efe99f18e72]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:24 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af Sep 28 05:23:24 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 Sep 28 05:23:25 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af" returned: 0 in 0.343s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f537950b-9a42-4906-ad5a-32ecbc227ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec4e30b-4215-4570-92ae-3f309cf021af', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2270c-0d13-4a9b-ba75-0c4537aada8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:25 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Volume volume-eec4e30b-4215-4570-92ae-3f309cf021af (eec4e30b-4215-4570-92ae-3f309cf021af): created successfully Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2270c-0d13-4a9b-ba75-0c4537aada8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (19ad819a-dd0e-4f99-9bed-78c546a70eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:25 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51" returned: 0 in 0.445s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1509a234-40e8-4ba6-8d56-66d0401f6d0e tempest-ProjectReaderTests-1910966125 None] Created volume successfully. Sep 28 05:23:25 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 Sep 28 05:23:25 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Creating offline snapshot 73d0834e-2857-4f02-b481-31032d29dc94 of volume 476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cc9337-1fdf-4253-a6da-66456e3a1986]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-eec4e30b-4215-4570-92ae-3f309cf021af-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-eec4e30b-4215-4570-92ae-3f309cf021af-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:25 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:25 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-quobyte-eec4e30b-4215-4570-92ae-3f309cf021af" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-eec4e30b-4215-4570-92ae-3f309cf021af" acquired by "delete_volume" :: waited 0.037s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d5556c-f589-451c-82e2-539419bc7a80]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:25 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" returned: 0 in 0.432s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:25 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3 Sep 28 05:23:25 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af Sep 28 05:23:25 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:25 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.478s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:26 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 1G Sep 28 05:23:26 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:26 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51.1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" returned: 0 in 0.318s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3" released by "_delete_snapshot" :: held 1.817s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" released by "delete_snapshot" :: held 1.897s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:26 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af" returned: 0 in 0.439s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:26 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af Sep 28 05:23:26 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Created reservations ['2a1fa485-1d67-4fa5-852c-139078863671', 'b062fdaa-709d-4f41-a2c9-46f4a90b7acb', 'e87c3cca-d0ce-4732-8eb2-0377ccb5eb1f', 'eae7e38e-4cc1-4b72-845e-bacc4ad03a57'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:26 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Delete snapshot completed successfully. Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-edce29f4-6e70-4cf1-b3e0-515c71f9621a tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-1556ed1b-6ebd-4a80-9c9a-aa3c7c094aa3-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-f507723a-fd52-4df0-b374-be7d2fa38e51-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-f507723a-fd52-4df0-b374-be7d2fa38e51-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:26 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 1G" returned: 0 in 0.572s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476306a6-7109-4617-aefe-16a4238bb6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:26 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eec4e30b-4215-4570-92ae-3f309cf021af" returned: 0 in 0.362s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476306a6-7109-4617-aefe-16a4238bb6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:26 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-eec4e30b-4215-4570-92ae-3f309cf021af" released by "delete_volume" :: held 0.870s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6cd051-c2fd-42a8-ab3d-98dd25bd9ba1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Created reservations ['50fcaedb-8178-43a4-8fd4-f3f30c7ac718', '20087ae8-000b-4c2f-88f4-66a25665bba3', '7ef201d8-2ce0-441d-90da-39dd61100e3f', '1ae94700-c520-4960-b8c4-89040972a358'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:26 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 Sep 28 05:23:26 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:26 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:26 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:26 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-476306a6-7109-4617-aefe-16a4238bb6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.400s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:26 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 is being set with open permissions: ugo+rw Sep 28 05:23:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:27 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:27 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:27 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.309s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Deleted volume successfully. Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1cfc0f56-48f5-42c2-a1e9-7fa151629be2 tempest-ProjectReaderTests-1910966125 None] Lock "cinder-eec4e30b-4215-4570-92ae-3f309cf021af-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:27 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51" returned: 0 in 0.575s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:27 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:27 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51 Sep 28 05:23:27 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:27 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info Sep 28 05:23:27 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:27 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (dd08981b-00ba-4c52-8164-852c4bc864b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3264a0ab-a741-4994-84aa-6387443223b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f507723a-fd52-4df0-b374-be7d2fa38e51" returned: 0 in 0.335s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3264a0ab-a741-4994-84aa-6387443223b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717206815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bff9fd-b884-46d0-8de6-506af52394ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:28Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4c4e0-9f8d-4521-8fbc-f01ce55c88bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4c4e0-9f8d-4521-8fbc-f01ce55c88bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086366b6-c2cf-4de5-9777-9db20ca73935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086366b6-c2cf-4de5-9777-9db20ca73935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bff9fd-b884-46d0-8de6-506af52394ae', 'volume_name': 'volume-35bff9fd-b884-46d0-8de6-506af52394ae', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7e8f88-491c-4b92-9151-810caeea177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7e8f88-491c-4b92-9151-810caeea177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d8f10d-ed8a-4906-9cc5-65a0f7fcc1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Volume 35bff9fd-b884-46d0-8de6-506af52394ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bff9fd-b884-46d0-8de6-506af52394ae', 'volume_size': 1} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:27 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-f507723a-fd52-4df0-b374-be7d2fa38e51" released by "delete_volume" :: held 1.062s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info" returned: 0 in 0.336s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:27 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info is being set with open permissions: ugo+rw Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:27 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info Sep 28 05:23:27 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Created reservations ['6091d6ad-960b-49b2-be24-d640ded5fc59', 'f306cbe9-ef11-491d-bba3-70abca5e175e', '734577c0-9e36-458e-be9b-dc8538a5c315', 'a5c7656a-708c-4c6d-ad2b-4d6d54337edf'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:27 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:27 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:28 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.info" returned: 0 in 0.301s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717206815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bff9fd-b884-46d0-8de6-506af52394ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc394b886f744cf7bb2b4f3eac4999f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:28Z,use_quota=True,user_id='2017b17b0e5d4fcda27d60084c0e62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Creating volume 35bff9fd-b884-46d0-8de6-506af52394ae {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:28 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:28 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae 1073741824 Sep 28 05:23:28 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c1931ea2-8f3d-4774-a0f5-71364276f39e tempest-VolumeDependencyTests-637097824 None] Create snapshot completed successfully Sep 28 05:23:28 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Deleted volume successfully. Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-61bddad2-e7c5-4172-aa10-ac5b26858cfc tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-f507723a-fd52-4df0-b374-be7d2fa38e51-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:28 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae 1073741824" returned: 0 in 0.495s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:28 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae Sep 28 05:23:28 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-cb7efda8-57cc-438b-9e80-3acfaecd00e2-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-cb7efda8-57cc-438b-9e80-3acfaecd00e2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "cinder-quobyte-cb7efda8-57cc-438b-9e80-3acfaecd00e2" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:28 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae" returned: 0 in 0.333s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-cb7efda8-57cc-438b-9e80-3acfaecd00e2" acquired by "delete_volume" :: waited 0.030s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d8f10d-ed8a-4906-9cc5-65a0f7fcc1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bff9fd-b884-46d0-8de6-506af52394ae', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa40b98-102e-4512-9a29-2fe040279c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a29ef5d-95f0-48e8-9bdd-87552858e1c1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:28 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Volume volume-35bff9fd-b884-46d0-8de6-506af52394ae (35bff9fd-b884-46d0-8de6-506af52394ae): created successfully Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa40b98-102e-4512-9a29-2fe040279c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Flow 'volume_create_manager' (dd08981b-00ba-4c52-8164-852c4bc864b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-080f19a2-7592-4a6e-8ec5-db3362db50b6 tempest-ProjectReaderTests-1910966125 None] Created volume successfully. Sep 28 05:23:29 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 Sep 28 05:23:29 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Flow 'volume_create_manager' (afb2b369-d8f8-4ffe-930e-0880a75b2ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f3918e-605f-4d55-b76f-fa375687433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:29 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2" returned: 0 in 0.444s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:29 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:29 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f3918e-605f-4d55-b76f-fa375687433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-257041857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f38d74a-b442-4493-9a4f-f23d98f96234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e5ee5943304a89b85726c36ec95b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73d0834e-2857-4f02-b481-31032d29dc94,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:29Z,use_quota=True,user_id='7dfcef9da3484950b3a695ad509ed6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827d9ad4-db6d-45c6-b701-119ba6785c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:29 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2 Sep 28 05:23:29 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827d9ad4-db6d-45c6-b701-119ba6785c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a62e3e-b553-41b0-994b-950c86c2beba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a62e3e-b553-41b0-994b-950c86c2beba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f38d74a-b442-4493-9a4f-f23d98f96234', 'volume_name': 'volume-1f38d74a-b442-4493-9a4f-f23d98f96234', 'volume_size': 1, 'snapshot_id': '73d0834e-2857-4f02-b481-31032d29dc94'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f16573-2f38-44f3-a718-982cbc656b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f16573-2f38-44f3-a718-982cbc656b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f52d3-6dfe-4603-a2fa-d4e424beb278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:29 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Volume 1f38d74a-b442-4493-9a4f-f23d98f96234: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f38d74a-b442-4493-9a4f-f23d98f96234', 'volume_size': 1, 'snapshot_id': '73d0834e-2857-4f02-b481-31032d29dc94'} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94-1f38d74a-b442-4493-9a4f-f23d98f96234" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94-1f38d74a-b442-4493-9a4f-f23d98f96234" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Creating volume 1f38d74a-b442-4493-9a4f-f23d98f96234 from snapshot 73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] snapshot: 73d0834e-2857-4f02-b481-31032d29dc94, volume: 1f38d74a-b442-4493-9a4f-f23d98f96234, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f85fc-8b4a-4e80-9251-d4d928616c72]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-35bff9fd-b884-46d0-8de6-506af52394ae-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:29 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.411s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "cinder-35bff9fd-b884-46d0-8de6-506af52394ae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:29 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-cb7efda8-57cc-438b-9e80-3acfaecd00e2" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-quobyte-cb7efda8-57cc-438b-9e80-3acfaecd00e2" released by "delete_volume" :: held 0.936s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:29 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:29 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Acquiring lock "cinder-quobyte-35bff9fd-b884-46d0-8de6-506af52394ae" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-35bff9fd-b884-46d0-8de6-506af52394ae" acquired by "delete_volume" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b74182-8961-421a-80b3-30ae0441a705]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Created reservations ['012e36d9-d77b-4519-bbb7-6c7d017e2d7e', '63fca5ef-c6cd-48c0-8ccc-457ebe737155', '136527b7-4815-458a-896d-20703c2af7c5', 'a4b02b68-f5f7-4eae-a839-df21df1d7a25'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:30 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:30 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:30 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae Sep 28 05:23:30 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:30 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.563s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-476306a6-7109-4617-aefe-16a4238bb6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066c667-8714-473b-abfc-a18ab9a4bc20]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:30 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:30 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Deleted volume successfully. Sep 28 05:23:30 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:30 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-46464b1c-0c95-44ac-8741-453364fab0b6 tempest-CinderUnicodeTest-1356556116 None] Lock "cinder-cb7efda8-57cc-438b-9e80-3acfaecd00e2-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:30 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae" returned: 0 in 0.505s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:30 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae Sep 28 05:23:30 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:30 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.443s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:30 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 Sep 28 05:23:30 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:30 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-35bff9fd-b884-46d0-8de6-506af52394ae" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "cinder-quobyte-35bff9fd-b884-46d0-8de6-506af52394ae" released by "delete_volume" :: held 0.886s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Created reservations ['0434e3c3-1ca7-4945-bf23-6a098d691dd2', '5bc71aad-fecc-442b-b1f9-c091e082dd75', 'ed41384b-ba05-4ec2-804b-a716a2a342a5', '73ce810d-b260-4b24-9bae-c8a4eed8ee55'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:31 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:31 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:31 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.324s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:31 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Deleted volume successfully. Sep 28 05:23:31 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f57c2919-d8e3-4f87-a035-3e8eba24049b tempest-ProjectReaderTests-1910966125 None] Lock "cinder-35bff9fd-b884-46d0-8de6-506af52394ae-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (b5426538-406e-4b29-a899-bfe23c16dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59c5b62-520f-4124-a7d3-ec0fccc3b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59c5b62-520f-4124-a7d3-ec0fccc3b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744491805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65dc04c-1c53-4120-aefb-f760d758e74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:36Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3727c08-ab77-483a-836a-17de3e9caac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3727c08-ab77-483a-836a-17de3e9caac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730667f-cad2-4618-a0e4-7553dfe7ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730667f-cad2-4618-a0e4-7553dfe7ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65dc04c-1c53-4120-aefb-f760d758e74e', 'volume_name': 'volume-e65dc04c-1c53-4120-aefb-f760d758e74e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275fa507-834e-45cb-ba6c-99614730c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275fa507-834e-45cb-ba6c-99614730c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1edfa9-d108-46af-affa-d09039c0d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:36 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Volume e65dc04c-1c53-4120-aefb-f760d758e74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65dc04c-1c53-4120-aefb-f760d758e74e', 'volume_size': 1} Sep 28 05:23:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:39 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234" returned: 0 in 8.786s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:23:39 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Converted 1024.00 MB image at 116.53 MB/s Sep 28 05:23:39 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 is being set with open permissions: ugo+rw Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:39 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 Sep 28 05:23:39 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:39 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234" returned: 0 in 0.273s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" released by "_copy_volume_from_snapshot" :: held 10.236s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=206,cinder:UPDATE=309,cinder:INSERT=71,cinder:DELETE=28 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=288,cinder:SELECT=222,cinder:INSERT=85,cinder:DELETE=26 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94-1f38d74a-b442-4493-9a4f-f23d98f96234" released by "_create_volume_from_snapshot" :: held 10.332s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.354s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.409s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744491805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65dc04c-1c53-4120-aefb-f760d758e74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:36Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Creating volume e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:39 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f52d3-6dfe-4603-a2fa-d4e424beb278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f38d74a-b442-4493-9a4f-f23d98f96234', 'volume_size': 1, 'snapshot_id': '73d0834e-2857-4f02-b481-31032d29dc94'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c73a0c-2433-4c56-851a-a3ac4054b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:39 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e 1073741824 Sep 28 05:23:39 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:39 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Volume volume-1f38d74a-b442-4493-9a4f-f23d98f96234 (1f38d74a-b442-4493-9a4f-f23d98f96234): created successfully Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c73a0c-2433-4c56-851a-a3ac4054b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:39 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Flow 'volume_create_manager' (afb2b369-d8f8-4ffe-930e-0880a75b2ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:39 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-901579d7-ff2a-4248-b82b-4bc6caa3caa9 tempest-VolumeDependencyTests-637097824 None] Created volume successfully. Sep 28 05:23:40 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e 1073741824" returned: 0 in 0.528s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:40 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e Sep 28 05:23:40 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-73d0834e-2857-4f02-b481-31032d29dc94-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-73d0834e-2857-4f02-b481-31032d29dc94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Deleting offline snapshot 73d0834e-2857-4f02-b481-31032d29dc94 of volume 476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] snapshot_file for this snap is: volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69af867-063e-476b-ba98-84c6503d8a17]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:40 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1edfa9-d108-46af-affa-d09039c0d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65dc04c-1c53-4120-aefb-f760d758e74e', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc152d44-5302-4f66-a845-88e6447a3076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:40 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Volume volume-e65dc04c-1c53-4120-aefb-f760d758e74e (e65dc04c-1c53-4120-aefb-f760d758e74e): created successfully Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc152d44-5302-4f66-a845-88e6447a3076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:40 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (b5426538-406e-4b29-a899-bfe23c16dc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:40 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:40 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9e09b9af-eaf5-4415-a75d-6a9c3cf80e70 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:23:41 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.484s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-476306a6-7109-4617-aefe-16a4238bb6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68cb1c1-b0dd-438e-813a-9245d814519c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:41 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:41 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 55b962b1-66b3-4790-b403-ebd3e2377531 of volume e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e53674-bdc0-40eb-a9e6-1a2c9719ffdb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:41 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.688s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:41 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:41 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:42 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e Sep 28 05:23:42 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:42 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.481s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:42 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94 Sep 28 05:23:42 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:42 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e" returned: 0 in 0.574s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:42 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 1G Sep 28 05:23:42 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:42 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5.73d0834e-2857-4f02-b481-31032d29dc94" returned: 0 in 0.321s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-73d0834e-2857-4f02-b481-31032d29dc94" released by "_delete_snapshot" :: held 2.162s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" released by "delete_snapshot" :: held 2.205s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:42 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Created reservations ['7bd1c747-6e38-46e7-9e61-e514bb485eee', '012cd296-ba6a-4616-8376-6a88c9cf0d49', 'a2e19f0c-575c-4e60-b13f-c02e0f6aa37a', '32a7bbfe-0a76-40cc-9267-d4f728e105e7'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:43 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Delete snapshot completed successfully. Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-9384bc1b-0167-4372-92fe-a5798d7bad9e tempest-VolumeDependencyTests-637097824 None] Lock "cinder-73d0834e-2857-4f02-b481-31032d29dc94-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:43 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 1G" returned: 0 in 0.599s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65dc04c-1c53-4120-aefb-f760d758e74e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:43 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65dc04c-1c53-4120-aefb-f760d758e74e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 Sep 28 05:23:43 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:43 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65dc04c-1c53-4120-aefb-f760d758e74e -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531" returned: 0 in 0.395s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:43 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 is being set with open permissions: ugo+rw Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:43 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 Sep 28 05:23:43 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:43 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-476306a6-7109-4617-aefe-16a4238bb6f5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531" returned: 0 in 0.377s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-476306a6-7109-4617-aefe-16a4238bb6f5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:43 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info Sep 28 05:23:43 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b9d33-dcb0-4bf6-946b-029ab743cec3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:44 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:44 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:44 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info" returned: 0 in 0.360s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:44 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info is being set with open permissions: ugo+rw Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:44 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info Sep 28 05:23:44 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:44 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.492s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:44 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5 Sep 28 05:23:44 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:44 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.info" returned: 0 in 0.355s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ba9d7efd-1b24-44d6-a79c-4be8b5b55c4b tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:23:44 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-476306a6-7109-4617-aefe-16a4238bb6f5" returned: 0 in 0.272s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-476306a6-7109-4617-aefe-16a4238bb6f5" released by "delete_volume" :: held 0.864s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:44 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Created reservations ['eb49f0fa-9e35-4f43-a93d-fc7581970bf7', 'fb6adb9e-b6ce-49ac-bee1-41fc9a83b637', 'f8211d82-9bd5-4367-a2f4-56445aba8b98', 'd51a81bd-4ce1-45ac-8e56-a6a3d6c78155'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:45 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:45 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-1f38d74a-b442-4493-9a4f-f23d98f96234-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-55b962b1-66b3-4790-b403-ebd3e2377531-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-1f38d74a-b442-4493-9a4f-f23d98f96234-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-55b962b1-66b3-4790-b403-ebd3e2377531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-55b962b1-66b3-4790-b403-ebd3e2377531" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-55b962b1-66b3-4790-b403-ebd3e2377531" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 55b962b1-66b3-4790-b403-ebd3e2377531 of volume e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" acquired by "delete_volume" :: waited 0.053s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e156bb-0f97-4947-bad5-e1668221775b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b7b57-57b6-46da-95e0-224113d4fa2b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:45 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.329s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Deleted volume successfully. Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8d1e3ab0-d069-496e-9232-8f4be6363667 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-476306a6-7109-4617-aefe-16a4238bb6f5-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:45 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 Sep 28 05:23:45 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:45 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 Sep 28 05:23:45 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:45 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531" returned: 0 in 0.444s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65dc04c-1c53-4120-aefb-f760d758e74e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e37ee3-63fd-49bf-bb34-c335c950f827]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:45 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234" returned: 0 in 0.533s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:45 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234 Sep 28 05:23:45 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:45 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e Sep 28 05:23:45 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:46 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-1f38d74a-b442-4493-9a4f-f23d98f96234" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-quobyte-1f38d74a-b442-4493-9a4f-f23d98f96234" released by "delete_volume" :: held 0.954s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Created reservations ['63825111-a7ee-494a-8777-78bf003d13b7', '4fd7cde5-6c44-43d0-8353-101430076dc4', 'd8f5a227-c8de-4c39-9010-562d5958ed0d', 'b77f99d0-8b58-45ff-a9a2-20c8a7cc93d2'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:46 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e" returned: 0 in 0.591s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:46 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 Sep 28 05:23:46 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:46 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:46 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:46 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.336s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:46 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Deleted volume successfully. Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-449c03f9-8561-4586-a7b2-ca6b04acc327 tempest-VolumeDependencyTests-637097824 None] Lock "cinder-1f38d74a-b442-4493-9a4f-f23d98f96234-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:46 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531" returned: 0 in 0.541s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:46 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531 Sep 28 05:23:46 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:47 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e.55b962b1-66b3-4790-b403-ebd3e2377531" returned: 0 in 0.279s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-55b962b1-66b3-4790-b403-ebd3e2377531" released by "_delete_snapshot" :: held 2.031s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" released by "delete_snapshot" :: held 2.072s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:47 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Created reservations ['aac41d9f-9f9f-4409-8279-470532d1322b', '24997f58-9956-4a6a-b3e2-6e886cbfe7c1', 'a7bcbddf-c9d8-4768-adfb-35bc61a6d14c', '785d6931-75c1-4a20-8d60-315b3e338ae5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:47 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:23:47 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4726e8dd-9c8d-4771-8526-d2473d5a8f7b tempest-ProjectMemberTests-2095540116 None] Lock "cinder-55b962b1-66b3-4790-b403-ebd3e2377531-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-e65dc04c-1c53-4120-aefb-f760d758e74e-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-e65dc04c-1c53-4120-aefb-f760d758e74e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e2bd7-9afe-483a-9907-99d57f832ceb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:48 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e Sep 28 05:23:48 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:49 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e" returned: 0 in 0.528s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:49 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e Sep 28 05:23:49 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:49 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-e65dc04c-1c53-4120-aefb-f760d758e74e" returned: 0 in 0.305s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-e65dc04c-1c53-4120-aefb-f760d758e74e" released by "delete_volume" :: held 0.952s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Created reservations ['c1ff9bb7-e01f-471b-9e14-afff68e0c148', '4bb64ff3-fcf4-48c6-be7d-c0c06514891a', 'c81363aa-994f-48cc-9be2-594191e9bb08', '71ccff46-f35c-4358-b1bf-d3d6011e03db'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:49 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:23:49 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:50 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.395s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:50 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:23:50 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:23:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-964d827d-a810-4bce-8aed-bef558d19f45 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-e65dc04c-1c53-4120-aefb-f760d758e74e-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (06a222c3-6915-4d3c-947e-0970675387ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c24c7ed-9c42-4de3-b1ba-0e5565bbcebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c24c7ed-9c42-4de3-b1ba-0e5565bbcebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326351781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:51Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbf5b0c-dbf6-4787-bdfa-28d498fc0c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbf5b0c-dbf6-4787-bdfa-28d498fc0c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3770b73c-efeb-4c57-882a-f2e18b905ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3770b73c-efeb-4c57-882a-f2e18b905ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9', 'volume_name': 'volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41612900-6064-473b-8ff8-e2ac824ea643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41612900-6064-473b-8ff8-e2ac824ea643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89a4cec-7bb9-4968-b7cf-f8d0078701f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:51 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Volume d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9', 'volume_size': 1} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326351781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:23:51Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Creating volume d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:23:51 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:51 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 1073741824 Sep 28 05:23:51 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:51 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-1bc19612-55c1-4bc7-805a-181ebe86cfbb tempest-ProjectAdminTests-1020019476 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1707000732422, 'free_capacity_gb': 1775.1707000732422, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86815) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 05:23:52 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 1073741824" returned: 0 in 0.611s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:52 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 Sep 28 05:23:52 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:52 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89a4cec-7bb9-4968-b7cf-f8d0078701f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86806bde-9e20-41fc-8d77-7ba5f607415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:23:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Volume volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 (d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9): created successfully Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86806bde-9e20-41fc-8d77-7ba5f607415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:23:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (06a222c3-6915-4d3c-947e-0970675387ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:23:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b76429a3-8129-4c96-911f-4ef3977c3c97 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:23:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:23:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:23:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot b43a58fe-84c9-4cce-9ef7-ee81274a76ed of volume d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:23:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5801f12-6b21-4d74-ac8f-4e5a9ec3c1ba]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:53 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 Sep 28 05:23:53 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:54 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" returned: 0 in 0.551s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:54 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed 1G Sep 28 05:23:54 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:54 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed 1G" returned: 0 in 0.538s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:54 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed Sep 28 05:23:54 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:55 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:55 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed is being set with open permissions: ugo+rw Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:55 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed Sep 28 05:23:55 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:55 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed" returned: 0 in 0.343s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:55 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info Sep 28 05:23:55 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:55 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info" returned: 0 in 0.298s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:55 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info is being set with open permissions: ugo+rw Sep 28 05:23:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:55 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info Sep 28 05:23:55 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:56 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.info" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:23:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-ece3470f-3e97-4b20-af09-3dfd918832d1 tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-b43a58fe-84c9-4cce-9ef7-ee81274a76ed-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-b43a58fe-84c9-4cce-9ef7-ee81274a76ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-b43a58fe-84c9-4cce-9ef7-ee81274a76ed" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-b43a58fe-84c9-4cce-9ef7-ee81274a76ed" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot b43a58fe-84c9-4cce-9ef7-ee81274a76ed of volume d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4d841-a04c-4578-83f6-65af747167cc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:57 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed Sep 28 05:23:57 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:57 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed" returned: 0 in 0.451s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2842dca6-aae5-4442-8192-24d8a0080527]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:23:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:57 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 Sep 28 05:23:57 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:58 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" returned: 0 in 0.534s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:58 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed Sep 28 05:23:58 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:58 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed" returned: 0 in 0.491s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:23:58 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed Sep 28 05:23:58 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:23:59 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 28 05:23:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9.b43a58fe-84c9-4cce-9ef7-ee81274a76ed" returned: 0 in 0.375s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:23:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-b43a58fe-84c9-4cce-9ef7-ee81274a76ed" released by "_delete_snapshot" :: held 2.087s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" released by "delete_snapshot" :: held 2.130s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:23:59 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Created reservations ['28909d10-8bba-46c8-b57f-4df070ce8147', '211b1738-3989-4883-a777-7915a8c91434', 'fb586af7-f731-42a3-9d1f-a18d6d04000b', 'cfde15c0-637f-4fab-85b2-30aecf9e1d98'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:23:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:23:59 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-93083892-449e-48cf-9633-5ece4d961c53 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-b43a58fe-84c9-4cce-9ef7-ee81274a76ed-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "cinder-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" acquired by "delete_volume" :: waited 0.034s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce08ee5d-ba53-4104-a37b-19bedb6e159f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:00 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 Sep 28 05:24:00 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:00 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" returned: 0 in 0.402s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:00 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9 Sep 28 05:24:00 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:01 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9" released by "delete_volume" :: held 0.786s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Created reservations ['6a1f04c6-7854-4781-a1c2-4ee306e09a12', 'f02d3213-9cc1-4c8c-b62b-de7b5567e890', '54244748-5e40-46b7-bac1-a0ce8d6c6508', 'de30f62d-0ee0-4232-b65c-bf28987f3af7'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:01 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:01 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:01 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.298s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:01 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:01 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4c720515-0813-434c-9af7-691eee328acd tempest-ProjectMemberTests-2095540116 None] Lock "cinder-d50eeee7-41b9-4cf1-8e25-cfa3c14ae9c9-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (61cf0373-5f2a-43e4-b4a9-96c18613ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd14cd8c-66d7-4ddd-b78f-2243976874d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd14cd8c-66d7-4ddd-b78f-2243976874d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561241570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda3671d-180f-4629-8fea-1fae9fbf8b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:02Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafdde8-4609-4845-b792-8b832c1f37a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafdde8-4609-4845-b792-8b832c1f37a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215bab2c-cd92-4e8c-8d69-88f045caaf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215bab2c-cd92-4e8c-8d69-88f045caaf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda3671d-180f-4629-8fea-1fae9fbf8b69', 'volume_name': 'volume-eda3671d-180f-4629-8fea-1fae9fbf8b69', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79517ef-b5fe-4348-9922-f8c087028142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79517ef-b5fe-4348-9922-f8c087028142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3251d-1a03-4f85-99a2-61698bd3c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:02 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Volume eda3671d-180f-4629-8fea-1fae9fbf8b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda3671d-180f-4629-8fea-1fae9fbf8b69', 'volume_size': 1} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561241570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda3671d-180f-4629-8fea-1fae9fbf8b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:02Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Creating volume eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:02 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:02 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 1073741824 Sep 28 05:24:02 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:03 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 1073741824" returned: 0 in 0.555s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:03 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 Sep 28 05:24:03 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:03 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69" returned: 0 in 0.310s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3251d-1a03-4f85-99a2-61698bd3c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda3671d-180f-4629-8fea-1fae9fbf8b69', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f6c154-1a6e-4b76-8f15-5dd31500e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:03 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Volume volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 (eda3671d-180f-4629-8fea-1fae9fbf8b69): created successfully Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f6c154-1a6e-4b76-8f15-5dd31500e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:03 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (61cf0373-5f2a-43e4-b4a9-96c18613ca97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:03 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7116ce9c-cfa0-46b7-8efe-1ff4d3294af6 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:04 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c of volume eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:04 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23fb8b4-0a2d-4fc3-887e-2abea86176f6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:05 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 Sep 28 05:24:05 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:05 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69" returned: 0 in 0.419s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:05 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c 1G Sep 28 05:24:05 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:05 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c 1G" returned: 0 in 0.495s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:05 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c Sep 28 05:24:05 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Flow 'volume_create_manager' (e1009957-7563-4076-9e04-ce1d89f6902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1001c07-b11c-4365-a0b8-8dc34f649ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1001c07-b11c-4365-a0b8-8dc34f649ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1398988797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406226f3-187d-40a0-91a4-51c6a14cbeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b02c936ce4629bf31d468f624f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:06Z,use_quota=True,user_id='5ed96dd7489e41fe9d5284333234c62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cce901-8f65-45be-adae-fc05e7f7f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cce901-8f65-45be-adae-fc05e7f7f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f40a86b-5ee0-4c27-ad67-158bd38dfbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f40a86b-5ee0-4c27-ad67-158bd38dfbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406226f3-187d-40a0-91a4-51c6a14cbeef', 'volume_name': 'volume-406226f3-187d-40a0-91a4-51c6a14cbeef', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7279cc-c858-4bd9-a2d7-70d31604abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7279cc-c858-4bd9-a2d7-70d31604abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a2d452-f42b-4660-bbc0-91bacf3fe489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:06 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Volume 406226f3-187d-40a0-91a4-51c6a14cbeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406226f3-187d-40a0-91a4-51c6a14cbeef', 'volume_size': 1} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:06 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" returned: 0 in 0.370s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:06 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c is being set with open permissions: ugo+rw Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:06 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c Sep 28 05:24:06 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:06 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" returned: 0 in 0.240s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:06 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info Sep 28 05:24:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:06 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info" returned: 0 in 0.254s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:06 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info is being set with open permissions: ugo+rw Sep 28 05:24:06 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:06 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info Sep 28 05:24:06 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:07 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.info" returned: 0 in 0.260s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1398988797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406226f3-187d-40a0-91a4-51c6a14cbeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b02c936ce4629bf31d468f624f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:06Z,use_quota=True,user_id='5ed96dd7489e41fe9d5284333234c62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Creating volume 406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:07 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:07 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef 1073741824 Sep 28 05:24:07 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-abf34bda-b460-4384-bf58-a374111ba662 tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:07 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef 1073741824" returned: 0 in 0.455s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:07 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:07 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:07 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.256s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a2d452-f42b-4660-bbc0-91bacf3fe489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406226f3-187d-40a0-91a4-51c6a14cbeef', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a1bdd-2357-478b-bf9d-eb8c0123fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:07 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Volume volume-406226f3-187d-40a0-91a4-51c6a14cbeef (406226f3-187d-40a0-91a4-51c6a14cbeef): created successfully Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a1bdd-2357-478b-bf9d-eb8c0123fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:07 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Flow 'volume_create_manager' (e1009957-7563-4076-9e04-ce1d89f6902d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:07 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8a507da5-665d-47b1-8f91-b78d30144a74 tempest-SnapshotDependencyTests-1059211626 None] Created volume successfully. Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c of volume eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d87df-81c6-4d7c-8879-4bb8d00d59e8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:08 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c Sep 28 05:24:08 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Creating offline snapshot 73ef0b60-36a4-41ae-8d52-25982168bf61 of volume 406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d75f71-3c83-44d6-b7bb-3097f712d347]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:08 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:08 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:08 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" returned: 0 in 0.384s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda3671d-180f-4629-8fea-1fae9fbf8b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194c9c1-203b-4e15-90fd-4ca710070da6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:08 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 Sep 28 05:24:08 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:08 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.390s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:08 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:08 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 1G Sep 28 05:24:08 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:09 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:09 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c Sep 28 05:24:09 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:09 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 1G" returned: 0 in 0.462s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406226f3-187d-40a0-91a4-51c6a14cbeef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:09 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406226f3-187d-40a0-91a4-51c6a14cbeef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:09 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:09 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" returned: 0 in 0.490s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:09 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c Sep 28 05:24:09 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:09 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406226f3-187d-40a0-91a4-51c6a14cbeef -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.402s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:09 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 is being set with open permissions: ugo+rw Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:09 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:09 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:09 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69.6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" returned: 0 in 0.302s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c" released by "_delete_snapshot" :: held 1.704s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:09 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" released by "delete_snapshot" :: held 1.747s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Created reservations ['3e5ee3c7-032f-40f8-8ef3-562d637f6982', '679fe8ca-5dd4-4a94-bf6f-1127533f8f9e', '82d028ea-10e2-43d7-9da5-c1dbd0f81e75', 'cdac56b2-166b-4de3-93d9-abbf1f5b7df6'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b2f4210d-1baa-43fd-9f49-0dcaeb6464ce tempest-ProjectMemberTests-2095540116 None] Lock "cinder-6f4619a4-1df3-48ba-ab7a-6bb2cd0e419c-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:10 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.311s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:10 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info Sep 28 05:24:10 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-eda3671d-180f-4629-8fea-1fae9fbf8b69-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:10 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-eda3671d-180f-4629-8fea-1fae9fbf8b69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:10 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info is being set with open permissions: ugo+rw Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:10 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info Sep 28 05:24:10 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb705d4a-305b-4091-872e-280675b6897e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:10 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 Sep 28 05:24:10 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:10 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.info" returned: 0 in 0.276s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3a7a38f9-7b72-40d5-a246-9c90b2debb78 tempest-SnapshotDependencyTests-1059211626 None] Create snapshot completed successfully Sep 28 05:24:11 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69" returned: 0 in 0.465s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:11 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69 Sep 28 05:24:11 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:11 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-eda3671d-180f-4629-8fea-1fae9fbf8b69" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-eda3671d-180f-4629-8fea-1fae9fbf8b69" released by "delete_volume" :: held 0.816s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Created reservations ['185b0cd5-877c-4dc4-9e34-8b5800e4959d', '877660ec-a249-4d9d-a90e-72149a448152', '6644d1ed-5fac-4125-bacf-352303acb9c8', '3565c88e-87ba-4c42-a147-ca6a4df08be7'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:11 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:11 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:11 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:11 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:11 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6ea173c0-0127-4e94-9dce-beb7e77e99f6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-eda3671d-180f-4629-8fea-1fae9fbf8b69-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (9cf27287-cb14-4424-a6b7-49eb0007458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8893c9ea-7c3f-4a45-aa7b-80b98f5a1ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8893c9ea-7c3f-4a45-aa7b-80b98f5a1ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349571525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c01975-61b2-44a1-a49d-ae55e87442b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:12Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1376409-6a5f-40f0-8249-88a424eacbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1376409-6a5f-40f0-8249-88a424eacbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1d0edb-a6b0-4be9-90b7-704a406eabf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1d0edb-a6b0-4be9-90b7-704a406eabf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c01975-61b2-44a1-a49d-ae55e87442b5', 'volume_name': 'volume-63c01975-61b2-44a1-a49d-ae55e87442b5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13379c48-ffa9-42ca-840d-aeae26943e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13379c48-ffa9-42ca-840d-aeae26943e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b9c3a8-8f7e-4de8-966b-7b6a42a86f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Volume 63c01975-61b2-44a1-a49d-ae55e87442b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c01975-61b2-44a1-a49d-ae55e87442b5', 'volume_size': 1} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349571525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c01975-61b2-44a1-a49d-ae55e87442b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:12Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Creating volume 63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:12 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:12 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 1073741824 Sep 28 05:24:12 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Flow 'volume_create_manager' (07217cd9-e2fc-42de-b5bb-2afd02bf8e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a33011a-8a77-41fe-a8e2-2719db7b5a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a33011a-8a77-41fe-a8e2-2719db7b5a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4295019f-58ef-43a9-90ec-9737fc159bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93b02c936ce4629bf31d468f624f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73ef0b60-36a4-41ae-8d52-25982168bf61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:12Z,use_quota=True,user_id='5ed96dd7489e41fe9d5284333234c62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b9d98-da0b-430f-afa5-f57f330dc40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185b9d98-da0b-430f-afa5-f57f330dc40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983bfb11-8715-43a6-ab6b-d6dde47d6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983bfb11-8715-43a6-ab6b-d6dde47d6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4295019f-58ef-43a9-90ec-9737fc159bc2', 'volume_name': 'volume-4295019f-58ef-43a9-90ec-9737fc159bc2', 'volume_size': 1, 'snapshot_id': '73ef0b60-36a4-41ae-8d52-25982168bf61'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15769981-5305-47a1-9f3e-ab41adaca790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15769981-5305-47a1-9f3e-ab41adaca790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103f7874-5390-4a12-90e1-1f49715a958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:12 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Volume 4295019f-58ef-43a9-90ec-9737fc159bc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4295019f-58ef-43a9-90ec-9737fc159bc2', 'volume_size': 1, 'snapshot_id': '73ef0b60-36a4-41ae-8d52-25982168bf61'} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:12 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 1073741824" returned: 0 in 0.486s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:12 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 Sep 28 05:24:12 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:13 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.506s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61-4295019f-58ef-43a9-90ec-9737fc159bc2" by "_create_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b9c3a8-8f7e-4de8-966b-7b6a42a86f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c01975-61b2-44a1-a49d-ae55e87442b5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3a249f-878b-4e23-9b36-55f2f591c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61-4295019f-58ef-43a9-90ec-9737fc159bc2" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Creating volume 4295019f-58ef-43a9-90ec-9737fc159bc2 from snapshot 73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" by "_copy_volume_from_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Volume volume-63c01975-61b2-44a1-a49d-ae55e87442b5 (63c01975-61b2-44a1-a49d-ae55e87442b5): created successfully Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3a249f-878b-4e23-9b36-55f2f591c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (9cf27287-cb14-4424-a6b7-49eb0007458f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] snapshot: 73ef0b60-36a4-41ae-8d52-25982168bf61, volume: 4295019f-58ef-43a9-90ec-9737fc159bc2, {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 05:24:13 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-125cd939-413d-4438-94d0-abae3f77581d tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5707abc4-974c-4cf1-ab0e-f13d15620af4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:13 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:13 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:13 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406226f3-187d-40a0-91a4-51c6a14cbeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d14669-37e7-4517-8813-3d1d5de1e099]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:13 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:13 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Flow 'volume_create_manager' (653b178d-5487-43e3-934d-fde93cac8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4d49fe-5992-4c8c-a756-a1a8bf4a7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4d49fe-5992-4c8c-a756-a1a8bf4a7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438763039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c959ff7-6998-4c44-b753-03f03c58f108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9140d50bda4c24ad8d0f5621b964eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:14Z,use_quota=True,user_id='a96701b9e60a485fa298b390cb419637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a3d12-d756-4512-9212-68fbf4ad6f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539a3d12-d756-4512-9212-68fbf4ad6f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f474141-d9b2-4abb-bab6-e6e31de7e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f474141-d9b2-4abb-bab6-e6e31de7e13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c959ff7-6998-4c44-b753-03f03c58f108', 'volume_name': 'volume-7c959ff7-6998-4c44-b753-03f03c58f108', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3721cc-36a0-4bf3-a960-74a3062db5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3721cc-36a0-4bf3-a960-74a3062db5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4031ad48-2aed-4d5b-b6ae-6fa020672ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:13 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Volume 7c959ff7-6998-4c44-b753-03f03c58f108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c959ff7-6998-4c44-b753-03f03c58f108', 'volume_size': 1} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.422s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Creating direct copy from snapshot {{(pid=86815) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG cinder.utils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Path /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 not found in is_blk_device check {{(pid=86815) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 05:24:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:14 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 Sep 28 05:24:14 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:20 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2" returned: 0 in 6.158s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.image.image_utils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Image conversion details: src /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 {{(pid=86815) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 05:24:20 devstack cinder-volume[86815]: INFO cinder.image.image_utils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Converted 1024.00 MB image at 166.26 MB/s Sep 28 05:24:20 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 is being set with open permissions: ugo+rw Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:20 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 Sep 28 05:24:20 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:20 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" released by "_copy_volume_from_snapshot" :: held 7.289s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61-4295019f-58ef-43a9-90ec-9737fc159bc2" released by "_create_volume_from_snapshot" :: held 7.370s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.407s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.461s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438763039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c959ff7-6998-4c44-b753-03f03c58f108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9140d50bda4c24ad8d0f5621b964eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:14Z,use_quota=True,user_id='a96701b9e60a485fa298b390cb419637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Creating volume 7c959ff7-6998-4c44-b753-03f03c58f108 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:20 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:20 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 1073741824 Sep 28 05:24:20 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103f7874-5390-4a12-90e1-1f49715a958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4295019f-58ef-43a9-90ec-9737fc159bc2', 'volume_size': 1, 'snapshot_id': '73ef0b60-36a4-41ae-8d52-25982168bf61'}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb05c1-d570-4153-9e39-eef05d11f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:20 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Volume volume-4295019f-58ef-43a9-90ec-9737fc159bc2 (4295019f-58ef-43a9-90ec-9737fc159bc2): created successfully Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb05c1-d570-4153-9e39-eef05d11f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Flow 'volume_create_manager' (07217cd9-e2fc-42de-b5bb-2afd02bf8e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:20 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-2c512281-0ee4-45a1-863f-1758517cc0d6 tempest-SnapshotDependencyTests-1059211626 None] Created volume successfully. Sep 28 05:24:20 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 1073741824" returned: 0 in 0.409s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:20 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 Sep 28 05:24:20 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-73ef0b60-36a4-41ae-8d52-25982168bf61-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-73ef0b60-36a4-41ae-8d52-25982168bf61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:21 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.746s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4031ad48-2aed-4d5b-b6ae-6fa020672ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c959ff7-6998-4c44-b753-03f03c58f108', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45ea457-0d6e-42ad-9bd6-d24efc50b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Deleting offline snapshot 73ef0b60-36a4-41ae-8d52-25982168bf61 of volume 406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] snapshot_file for this snap is: volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 of volume 63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ff731-d41c-4454-9f6f-f9a309d853ee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c5601-b7aa-495a-bab1-49d59b841bf7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:21 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Volume volume-7c959ff7-6998-4c44-b753-03f03c58f108 (7c959ff7-6998-4c44-b753-03f03c58f108): created successfully Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45ea457-0d6e-42ad-9bd6-d24efc50b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Flow 'volume_create_manager' (653b178d-5487-43e3-934d-fde93cac8b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-5440e889-8016-4004-ab93-ec445b2ca564 tempest-ProjectReaderTests-1131931903 None] Created volume successfully. Sep 28 05:24:21 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:21 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:21 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 Sep 28 05:24:21 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "cinder-7c959ff7-6998-4c44-b753-03f03c58f108-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:21 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406226f3-187d-40a0-91a4-51c6a14cbeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:21 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5" returned: 0 in 0.426s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651c427-c93e-4e42-8995-db276e717e59]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-7c959ff7-6998-4c44-b753-03f03c58f108-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:21 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 1G Sep 28 05:24:21 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "cinder-quobyte-7c959ff7-6998-4c44-b753-03f03c58f108" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-quobyte-7c959ff7-6998-4c44-b753-03f03c58f108" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed74a8-58d1-4d73-b260-005167bbd632]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:21 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:21 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:21 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 Sep 28 05:24:21 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 1G" returned: 0 in 0.466s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c01975-61b2-44a1-a49d-ae55e87442b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c01975-61b2-44a1-a49d-ae55e87442b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 Sep 28 05:24:22 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108" returned: 0 in 0.430s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108 Sep 28 05:24:22 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.601s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:22 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c01975-61b2-44a1-a49d-ae55e87442b5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" returned: 0 in 0.328s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 is being set with open permissions: ugo+rw Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 Sep 28 05:24:22 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7c959ff7-6998-4c44-b753-03f03c58f108" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-quobyte-7c959ff7-6998-4c44-b753-03f03c58f108" released by "delete_volume" :: held 0.765s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Created reservations ['2b669171-21ac-4b6c-a039-3e75e0aece52', 'a8c88026-7378-4cd1-9bab-e032d0a0660e', 'de74ac37-e8e3-4d05-8911-85f42e2bc04c', '73f99242-5573-4722-9a63-f7ea045fb34c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:22 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61 Sep 28 05:24:22 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" returned: 0 in 0.306s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:22 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info Sep 28 05:24:22 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:22 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.317s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:22 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Deleted volume successfully. Sep 28 05:24:22 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef.73ef0b60-36a4-41ae-8d52-25982168bf61" returned: 0 in 0.320s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-1b87401f-8e8d-47bf-979e-c11c4ea22569 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-7c959ff7-6998-4c44-b753-03f03c58f108-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-73ef0b60-36a4-41ae-8d52-25982168bf61" released by "_delete_snapshot" :: held 1.874s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" released by "delete_snapshot" :: held 1.925s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:23 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info" returned: 0 in 0.295s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:23 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info is being set with open permissions: ugo+rw Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:23 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info Sep 28 05:24:23 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Created reservations ['222b01b7-60ca-49d8-9f0a-224d46072e27', '5e0d8a87-1bf7-4362-b773-b49207affb9c', '968c60d9-9a1d-4225-a0f5-be24dd5765eb', '3588dc8f-9b84-4678-8cf5-6a90fca9c19a'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Delete snapshot completed successfully. Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-cc58b704-869b-4d28-b0fc-2f2493fc6dcd tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-73ef0b60-36a4-41ae-8d52-25982168bf61-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Flow 'volume_create_manager' (0faa7498-5d72-43b3-8e28-2ef888cb49a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6d1682-fa20-42c3-b707-732fcbd5f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:23 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.info" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6d1682-fa20-42c3-b707-732fcbd5f620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204730718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa71756-f402-4c0d-ad1f-939b92965386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9140d50bda4c24ad8d0f5621b964eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:23Z,use_quota=True,user_id='a96701b9e60a485fa298b390cb419637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6c2954-9af4-498e-87b0-1bdbe108dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6c2954-9af4-498e-87b0-1bdbe108dce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e7145-75bb-4ae3-a9c3-579434cbfca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e7145-75bb-4ae3-a9c3-579434cbfca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa71756-f402-4c0d-ad1f-939b92965386', 'volume_name': 'volume-7aa71756-f402-4c0d-ad1f-939b92965386', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f064fd15-2987-4a53-bc0f-6d601826810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f064fd15-2987-4a53-bc0f-6d601826810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea8263-8bb6-4d8c-a967-29af63675f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Volume 7aa71756-f402-4c0d-ad1f-939b92965386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa71756-f402-4c0d-ad1f-939b92965386', 'volume_size': 1} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204730718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa71756-f402-4c0d-ad1f-939b92965386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9140d50bda4c24ad8d0f5621b964eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:23Z,use_quota=True,user_id='a96701b9e60a485fa298b390cb419637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Creating volume 7aa71756-f402-4c0d-ad1f-939b92965386 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:23 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:23 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-04c53351-5872-4a2f-859c-6a797d81afbe tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:23 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 1073741824 Sep 28 05:24:23 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 of volume 63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:23 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 1073741824" returned: 0 in 0.492s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af4d97-92dc-4ee5-89f8-744a237940eb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:24 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 Sep 28 05:24:24 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:24 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 Sep 28 05:24:24 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:24 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea8263-8bb6-4d8c-a967-29af63675f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa71756-f402-4c0d-ad1f-939b92965386', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98934d4-7a83-4da4-a02f-ddd56fe77dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Volume volume-7aa71756-f402-4c0d-ad1f-939b92965386 (7aa71756-f402-4c0d-ad1f-939b92965386): created successfully Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98934d4-7a83-4da4-a02f-ddd56fe77dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Flow 'volume_create_manager' (0faa7498-5d72-43b3-8e28-2ef888cb49a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-406226f3-187d-40a0-91a4-51c6a14cbeef-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-709996c3-bacf-4f3f-9249-3559d00639fd tempest-ProjectReaderTests-1131931903 None] Created volume successfully. Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-406226f3-187d-40a0-91a4-51c6a14cbeef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:24 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" returned: 0 in 0.404s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63c01975-61b2-44a1-a49d-ae55e87442b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[125e1e82-ce3d-4554-b726-e658dab87452]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c078d52c-ccf7-4a27-ac5e-94a38e9897f0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:24 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 Sep 28 05:24:24 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:24 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:24 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:24 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:24 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 Sep 28 05:24:24 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:24 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.378s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:24 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef Sep 28 05:24:24 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:25 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:25 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" returned: 0 in 0.355s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-406226f3-187d-40a0-91a4-51c6a14cbeef" returned: 0 in 0.273s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:25 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54 Sep 28 05:24:25 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-406226f3-187d-40a0-91a4-51c6a14cbeef" released by "delete_volume" :: held 0.721s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Created reservations ['7b53c258-59e7-475e-9fa6-d071ffd27dc0', 'cd884388-bbde-458a-99b4-90b344d085b8', '1294dce9-1b87-4fb8-8fea-c3ca4f68797a', '8b9d1588-5e09-4093-ac82-d00ef1d7124f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:25 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:25 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:25 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5.7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" returned: 0 in 0.261s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54" released by "_delete_snapshot" :: held 1.526s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" released by "delete_snapshot" :: held 1.549s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "cinder-7aa71756-f402-4c0d-ad1f-939b92965386-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-4295019f-58ef-43a9-90ec-9737fc159bc2-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:25 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-4295019f-58ef-43a9-90ec-9737fc159bc2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-7aa71756-f402-4c0d-ad1f-939b92965386-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Created reservations ['9638272e-9c57-4170-8be0-e4baaba50bea', '8a3d4ef6-6264-44d9-a536-a1d9ea775387', '5cc3d03c-d87a-4bd2-b879-dab44ebe7e45', 'b68e657a-49fa-487b-a38d-2ffa776ad720'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Deleted volume successfully. Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "cinder-quobyte-7aa71756-f402-4c0d-ad1f-939b92965386" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-86d3efd1-c366-460f-81de-df133f3c8adb tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-406226f3-187d-40a0-91a4-51c6a14cbeef-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-quobyte-7aa71756-f402-4c0d-ad1f-939b92965386" acquired by "delete_volume" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" acquired by "delete_volume" :: waited 0.036s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba36c0-8aa7-4b08-a856-7c2f9a1c7d6b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a316f-b95e-4eaa-a190-c34cd0a9e71b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:25 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:25 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-527a33d8-5225-4030-8801-54c8eb8da5e8 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-7cbef5e1-440f-4b35-9bc3-9e40cbaf6b54-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:25 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 Sep 28 05:24:25 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:25 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 Sep 28 05:24:25 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-63c01975-61b2-44a1-a49d-ae55e87442b5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "cinder-63c01975-61b2-44a1-a49d-ae55e87442b5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" acquired by "delete_volume" :: waited 0.025s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:26 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386" returned: 0 in 0.430s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[066427b5-94c6-4113-97e8-7152f838f807]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386 Sep 28 05:24:26 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2" returned: 0 in 0.444s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2 Sep 28 05:24:26 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 Sep 28 05:24:26 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7aa71756-f402-4c0d-ad1f-939b92965386" returned: 0 in 0.278s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-quobyte-7aa71756-f402-4c0d-ad1f-939b92965386" released by "delete_volume" :: held 0.757s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:26 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4295019f-58ef-43a9-90ec-9737fc159bc2" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-quobyte-4295019f-58ef-43a9-90ec-9737fc159bc2" released by "delete_volume" :: held 0.786s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Created reservations ['f01d3578-35e4-4431-ab2b-ed3f72bc7b13', 'f8478a52-6865-4ac8-8f08-fbcc32ed9f00', '55868b98-d07d-4c47-9370-a87512b242fa', '475cc7c8-4af3-46a5-8b2e-a6cdf4c01f90'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:26 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5" returned: 0 in 0.379s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Created reservations ['0a068f23-46d1-4b95-9771-b0f5dbfbb18d', 'f765a34e-fc04-4692-ad3d-bb8eb4b8a07b', '9815b4da-3429-4190-8304-ca70f8764145', 'd5230b8f-c213-4a27-a08b-75f013ba4037'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:26 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5 Sep 28 05:24:26 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:26 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:26 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:26 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:26 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-63c01975-61b2-44a1-a49d-ae55e87442b5" returned: 0 in 0.332s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-63c01975-61b2-44a1-a49d-ae55e87442b5" released by "delete_volume" :: held 0.800s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Created reservations ['cba261ea-8641-4170-92eb-8382a0dba99f', '9498b950-321e-4a4e-8345-8cd8962bc527', '15cceadb-cb77-4d84-99ee-63f918935b64', 'eb42c922-8291-478f-aa92-814b54a4f5c5'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:26 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.340s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:26 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Deleted volume successfully. Sep 28 05:24:27 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.312s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Deleted volume successfully. Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-381b0597-8565-4fd8-8433-d26fe9ded335 tempest-ProjectReaderTests-1131931903 None] Lock "cinder-7aa71756-f402-4c0d-ad1f-939b92965386-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-0daf5919-f924-4a87-a306-8da9b2ca83c2 tempest-SnapshotDependencyTests-1059211626 None] Lock "cinder-4295019f-58ef-43a9-90ec-9737fc159bc2-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:27 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:27 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:27 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.282s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:27 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a86c83c7-a876-4207-9891-ba63f0d3aabc tempest-ProjectMemberTests-2095540116 None] Lock "cinder-63c01975-61b2-44a1-a49d-ae55e87442b5-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (185af018-f058-4673-b2dc-c7bb5d7bed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1852e2-685d-41db-944d-2605fd9ee3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1852e2-685d-41db-944d-2605fd9ee3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418067016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f4a643-6675-4dd9-8354-e48d1e84d6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:28Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd70ec5-49cf-42b1-ad12-231dcba8cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd70ec5-49cf-42b1-ad12-231dcba8cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69bfc88-13f1-4068-9bc9-3a8e39b4bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69bfc88-13f1-4068-9bc9-3a8e39b4bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f4a643-6675-4dd9-8354-e48d1e84d6f5', 'volume_name': 'volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f22893-d35e-4ebf-b5a1-4db4eb949df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f22893-d35e-4ebf-b5a1-4db4eb949df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98644665-87f0-49d9-a4df-d4c6e492d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:27 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Volume 90f4a643-6675-4dd9-8354-e48d1e84d6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5', 'volume_size': 1} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418067016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f4a643-6675-4dd9-8354-e48d1e84d6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:28Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Creating volume 90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:27 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:27 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 1073741824 Sep 28 05:24:27 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:28 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 1073741824" returned: 0 in 0.540s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:28 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 Sep 28 05:24:28 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:28 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98644665-87f0-49d9-a4df-d4c6e492d68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58af87c1-7a80-4c47-895a-110ee46d75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:28 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Volume volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 (90f4a643-6675-4dd9-8354-e48d1e84d6f5): created successfully Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58af87c1-7a80-4c47-895a-110ee46d75eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:28 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (185af018-f058-4673-b2dc-c7bb5d7bed5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a495efc3-e483-402c-9e79-bbb2642fc944 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:29 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:29 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:29 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.282s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:24:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 78240e9c-92cc-423d-9144-184e143da211 of volume 90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eef099-9621-4db4-9511-5459019fa596]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:30 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 Sep 28 05:24:30 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:30 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5" returned: 0 in 0.431s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:30 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 1G Sep 28 05:24:30 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:31 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 1G" returned: 0 in 0.507s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:31 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 Sep 28 05:24:31 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:31 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211" returned: 0 in 0.307s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:31 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 is being set with open permissions: ugo+rw Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:31 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 Sep 28 05:24:31 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:31 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211" returned: 0 in 0.319s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:31 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info Sep 28 05:24:31 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:31 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info" returned: 0 in 0.310s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:31 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info is being set with open permissions: ugo+rw Sep 28 05:24:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:32 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info Sep 28 05:24:32 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:32 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.info" returned: 0 in 0.268s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:32 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4f511007-82f4-4261-b2ca-70486ba68cbf tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-78240e9c-92cc-423d-9144-184e143da211-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-78240e9c-92cc-423d-9144-184e143da211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-78240e9c-92cc-423d-9144-184e143da211" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-78240e9c-92cc-423d-9144-184e143da211" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 78240e9c-92cc-423d-9144-184e143da211 of volume 90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e348eb-43f2-479e-937f-ead7e79a3af8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:33 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 Sep 28 05:24:33 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:33 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211" returned: 0 in 0.449s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[086743f1-9b7e-411f-a5b4-3efc132e075d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:33 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 Sep 28 05:24:33 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:34 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:34 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 Sep 28 05:24:34 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:34 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211" returned: 0 in 0.347s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:34 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211 Sep 28 05:24:34 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:34 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5.78240e9c-92cc-423d-9144-184e143da211" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-78240e9c-92cc-423d-9144-184e143da211" released by "_delete_snapshot" :: held 1.595s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" released by "delete_snapshot" :: held 1.627s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:34 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Created reservations ['687d6bdc-9a35-4661-9951-2e399fc08eff', '811c4ab6-8112-4de9-8d97-8fad57862ab8', '9b738f8b-691d-4552-a506-7ab2bd168009', '1a9b9465-93c8-4421-a7f9-7fcf442ce29b'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-09c7df98-fd0e-4341-b660-f257bb82761f tempest-ProjectMemberTests-2095540116 None] Lock "cinder-78240e9c-92cc-423d-9144-184e143da211-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-90f4a643-6675-4dd9-8354-e48d1e84d6f5-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-90f4a643-6675-4dd9-8354-e48d1e84d6f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cfc672-763d-4603-8946-70062d810338]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:35 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 Sep 28 05:24:35 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:35 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5" returned: 0 in 0.380s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:35 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5 Sep 28 05:24:35 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:36 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-90f4a643-6675-4dd9-8354-e48d1e84d6f5" returned: 0 in 0.284s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-90f4a643-6675-4dd9-8354-e48d1e84d6f5" released by "delete_volume" :: held 0.726s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Created reservations ['ec71095e-7b22-47e5-830a-a2f86be49410', '1fbc07c1-888f-430d-87c4-ed7e6806094b', '6a1b0dd9-49a0-47e0-9ceb-6da2d7635d92', '616222b3-df00-461e-bfd3-2cbe34e7ba96'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:36 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:36 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:36 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.255s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-707fe672-a1a1-456e-84c3-0d1491ea0b0d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-90f4a643-6675-4dd9-8354-e48d1e84d6f5-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (3e83760c-f81c-4246-88f8-a65b0036fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dae9520-715e-4b3d-b1a7-873ed094ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dae9520-715e-4b3d-b1a7-873ed094ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257012044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cebb74-44d6-47a3-b9ab-8bb82c37c401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:37Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a85f1a5-2c56-4199-9cde-9e071fb00f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a85f1a5-2c56-4199-9cde-9e071fb00f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5397b854-f9a7-4748-bac3-a75e152c0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5397b854-f9a7-4748-bac3-a75e152c0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cebb74-44d6-47a3-b9ab-8bb82c37c401', 'volume_name': 'volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18b527b-9d0b-4329-aaa6-a13cbd8f4c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18b527b-9d0b-4329-aaa6-a13cbd8f4c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f871312f-e3e5-4143-9c7d-1e5a83c7c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Volume 36cebb74-44d6-47a3-b9ab-8bb82c37c401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401', 'volume_size': 1} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257012044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cebb74-44d6-47a3-b9ab-8bb82c37c401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:37Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Creating volume 36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:37 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 1073741824 Sep 28 05:24:37 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:37 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 1073741824" returned: 0 in 0.440s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:37 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 Sep 28 05:24:37 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:37 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401" returned: 0 in 0.313s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f871312f-e3e5-4143-9c7d-1e5a83c7c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510cd141-885e-4519-a7e4-c8aa17856a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Volume volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 (36cebb74-44d6-47a3-b9ab-8bb82c37c401): created successfully Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510cd141-885e-4519-a7e4-c8aa17856a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (3e83760c-f81c-4246-88f8-a65b0036fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:37 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-516bf8ed-611d-4fae-9b50-0baa3fa5f30d tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 9549b502-39aa-46c8-8971-4071537c5a1f of volume 36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a515a4-753a-4a27-92d9-49bf94a6bb62]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:39 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 Sep 28 05:24:39 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:39 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:39 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f 1G Sep 28 05:24:39 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:40 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f 1G" returned: 0 in 0.401s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:40 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f Sep 28 05:24:40 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:40 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:40 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f is being set with open permissions: ugo+rw Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:40 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f Sep 28 05:24:40 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:40 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f" returned: 0 in 0.237s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=147,cinder:INSERT=40,cinder:UPDATE=176,cinder:DELETE=13 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=160,cinder:DELETE=15,cinder:INSERT=49,cinder:SELECT=114 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:40 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info Sep 28 05:24:40 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:40 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:40 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info is being set with open permissions: ugo+rw Sep 28 05:24:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:40 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info Sep 28 05:24:40 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:41 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.info" returned: 0 in 0.240s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:41 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-922d40fb-eb66-4996-8c9d-6aa7376208b5 tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-9549b502-39aa-46c8-8971-4071537c5a1f-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-9549b502-39aa-46c8-8971-4071537c5a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-9549b502-39aa-46c8-8971-4071537c5a1f" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-9549b502-39aa-46c8-8971-4071537c5a1f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 9549b502-39aa-46c8-8971-4071537c5a1f of volume 36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[956afcd7-d799-4007-a0e4-afa2906dad61]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:41 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f Sep 28 05:24:41 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:41 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df069775-84c5-4e64-a0d8-88f108336c6f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:41 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 Sep 28 05:24:41 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:42 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401" returned: 0 in 0.363s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:42 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f Sep 28 05:24:42 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:42 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f" returned: 0 in 0.334s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:42 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f Sep 28 05:24:42 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:42 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401.9549b502-39aa-46c8-8971-4071537c5a1f" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-9549b502-39aa-46c8-8971-4071537c5a1f" released by "_delete_snapshot" :: held 1.399s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" released by "delete_snapshot" :: held 1.421s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Created reservations ['d33b93d6-a4bd-42c2-bff7-4799d75b3339', '6a8855ff-3509-4e4c-a017-5394efdb39f6', 'c32423b3-351f-4f3f-b766-26349bebdbe1', 'df664114-53fe-454e-886b-7c3056dd6c41'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-08037b83-dff9-4192-82bb-e424ee0a2e9d tempest-ProjectMemberTests-2095540116 None] Lock "cinder-9549b502-39aa-46c8-8971-4071537c5a1f-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-36cebb74-44d6-47a3-b9ab-8bb82c37c401-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-36cebb74-44d6-47a3-b9ab-8bb82c37c401-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd15c30-93a4-44ae-a00b-3bcea6805181]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:43 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 Sep 28 05:24:43 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:43 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401" returned: 0 in 0.362s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:44 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401 Sep 28 05:24:44 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:44 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-36cebb74-44d6-47a3-b9ab-8bb82c37c401" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-36cebb74-44d6-47a3-b9ab-8bb82c37c401" released by "delete_volume" :: held 0.672s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Created reservations ['538d391d-2bef-432e-93df-ff78315c794a', '5861a86f-43b9-4d4c-a22c-c2d558775320', 'f4013a97-bf88-4bab-ba15-31ff298fbb02', 'd0ef2843-347f-4476-b5cc-6e74345a1d98'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:44 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:44 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:44 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-a26e9fce-2458-4278-afbb-980f90fb1173 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-36cebb74-44d6-47a3-b9ab-8bb82c37c401-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (1605f49f-8f80-4590-aec8-1f33ca0580d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756177b-0853-42c7-bffb-3a1f13b3c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756177b-0853-42c7-bffb-3a1f13b3c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82731834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f024d9e2-f42c-42c2-a79a-5de1dfe10d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:45Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55efe0e3-601d-4382-a84c-1eefd65e830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55efe0e3-601d-4382-a84c-1eefd65e830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c0e3e2-5e10-43f8-960f-ff449778125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c0e3e2-5e10-43f8-960f-ff449778125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f024d9e2-f42c-42c2-a79a-5de1dfe10d3a', 'volume_name': 'volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8de3f3f-b8c1-4e9d-8ba2-d3c430ec310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8de3f3f-b8c1-4e9d-8ba2-d3c430ec310b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83d5760-b0bb-4873-b4d8-de235bea4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Volume f024d9e2-f42c-42c2-a79a-5de1dfe10d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a', 'volume_size': 1} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82731834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f024d9e2-f42c-42c2-a79a-5de1dfe10d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:45Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Creating volume f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:45 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:45 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a 1073741824 Sep 28 05:24:45 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:45 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a 1073741824" returned: 0 in 0.402s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:45 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a Sep 28 05:24:45 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:45 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83d5760-b0bb-4873-b4d8-de235bea4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be6bf39-b825-4390-b33f-ca233597e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:45 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Volume volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a (f024d9e2-f42c-42c2-a79a-5de1dfe10d3a): created successfully Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be6bf39-b825-4390-b33f-ca233597e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:45 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (1605f49f-8f80-4590-aec8-1f33ca0580d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:45 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c4fa0b28-9b54-4d17-8e58-d66de55c40ed tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot bf3cca6d-e32c-439f-86df-632d30f37bb8 of volume f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92554b81-f75f-4edf-9a45-7ec3c1833ef1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:46 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a Sep 28 05:24:46 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:46 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:46 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:46 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 1G Sep 28 05:24:46 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:47 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 1G" returned: 0 in 0.397s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:47 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 Sep 28 05:24:47 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:47 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8" returned: 0 in 0.293s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:47 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 is being set with open permissions: ugo+rw Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:47 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 Sep 28 05:24:47 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:47 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8" returned: 0 in 0.236s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:47 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info Sep 28 05:24:47 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:47 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info" returned: 0 in 0.251s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:47 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info is being set with open permissions: ugo+rw Sep 28 05:24:47 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:47 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info Sep 28 05:24:47 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:48 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.info" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:48 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4b84435e-cb5f-494c-b6de-ef9d734fb559 tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-bf3cca6d-e32c-439f-86df-632d30f37bb8-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-bf3cca6d-e32c-439f-86df-632d30f37bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-bf3cca6d-e32c-439f-86df-632d30f37bb8" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-bf3cca6d-e32c-439f-86df-632d30f37bb8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot bf3cca6d-e32c-439f-86df-632d30f37bb8 of volume f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e9105d-6c2d-4012-892c-27b1c0baf37a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:48 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 Sep 28 05:24:48 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:48 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8" returned: 0 in 0.359s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17593e-e9e5-4cb2-adb6-f913789a982a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:48 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:48 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a Sep 28 05:24:48 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:49 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:49 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 Sep 28 05:24:49 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:49 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8" returned: 0 in 0.326s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:49 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8 Sep 28 05:24:49 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:49 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a.bf3cca6d-e32c-439f-86df-632d30f37bb8" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-bf3cca6d-e32c-439f-86df-632d30f37bb8" released by "_delete_snapshot" :: held 1.382s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" released by "delete_snapshot" :: held 1.407s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Created reservations ['fd1c2c12-bcd0-4931-9edc-8f6044058521', '52236002-0fad-4cdd-9b57-4d7bfda6f2c0', '688d1de0-f2ba-4c36-a249-92b9df388aaa', '2f13f90a-32d5-486e-b47c-c5de5f6372b3'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:49 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:49 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-c47f540a-2847-473d-9ee6-3aca037eb3b6 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-bf3cca6d-e32c-439f-86df-632d30f37bb8-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd2acc-6ae6-4eec-a14a-f4be8d669f87]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:50 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a Sep 28 05:24:50 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:50 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:50 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:51 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a Sep 28 05:24:51 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:51 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a" released by "delete_volume" :: held 0.659s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Created reservations ['109a9786-38c1-4120-9a63-22e680ca4e62', '67d3b659-1587-445a-83d8-8ba0eac17171', '4e97aceb-1044-4799-8258-54b61eb590f9', 'e1620855-0645-440d-a212-659d02f1c2e4'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:51 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:51 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:51 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:51 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:51 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-f7e56d53-8396-43a0-9130-8d252f4142a2 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-f024d9e2-f42c-42c2-a79a-5de1dfe10d3a-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (8dc3707f-bca2-4388-914b-6537bccae8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a177af0-e69d-4d1d-bee6-cfcb6da02fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a177af0-e69d-4d1d-bee6-cfcb6da02fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941499521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7730e046-9191-46e4-8573-35498cd0ef81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:52Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b812bc-1d8c-43f2-ac07-0d98c4bdd1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b812bc-1d8c-43f2-ac07-0d98c4bdd1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7375e036-3f1c-4578-b0ca-1ca77ee1f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7375e036-3f1c-4578-b0ca-1ca77ee1f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7730e046-9191-46e4-8573-35498cd0ef81', 'volume_name': 'volume-7730e046-9191-46e4-8573-35498cd0ef81', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887981ba-53df-4776-909c-20fef39175a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887981ba-53df-4776-909c-20fef39175a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8755ed6-838e-4f22-b6be-1c91d7e13653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Volume 7730e046-9191-46e4-8573-35498cd0ef81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7730e046-9191-46e4-8573-35498cd0ef81', 'volume_size': 1} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941499521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7730e046-9191-46e4-8573-35498cd0ef81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:52Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Creating volume 7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:52 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:52 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 1073741824 Sep 28 05:24:52 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:52 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 1073741824" returned: 0 in 0.408s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:52 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 Sep 28 05:24:52 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:52 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8755ed6-838e-4f22-b6be-1c91d7e13653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7730e046-9191-46e4-8573-35498cd0ef81', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b654dc-9614-436c-8a7e-53184aa03212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:52 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Volume volume-7730e046-9191-46e4-8573-35498cd0ef81 (7730e046-9191-46e4-8573-35498cd0ef81): created successfully Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b654dc-9614-436c-8a7e-53184aa03212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:52 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (8dc3707f-bca2-4388-914b-6537bccae8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:52 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9f6db563-cf41-4dee-98ef-81174a743290 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot 86a32336-5879-43f7-bb5f-54436a4bff04 of volume 7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f9d71b-86b7-48f5-b923-b092a25c1af0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:53 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 Sep 28 05:24:53 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:53 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81" returned: 0 in 0.357s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:53 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:53 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 1G Sep 28 05:24:53 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:54 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 1G" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7730e046-9191-46e4-8573-35498cd0ef81 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:54 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7730e046-9191-46e4-8573-35498cd0ef81 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 Sep 28 05:24:54 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:54 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7730e046-9191-46e4-8573-35498cd0ef81 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:54 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 is being set with open permissions: ugo+rw Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:54 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 Sep 28 05:24:54 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:54 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04" returned: 0 in 0.240s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:54 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info Sep 28 05:24:54 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:54 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info" returned: 0 in 0.258s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:54 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info is being set with open permissions: ugo+rw Sep 28 05:24:54 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:54 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info Sep 28 05:24:54 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:55 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.info" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:55 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-cc44fa6d-45ac-4d43-b0c8-96ad70c7deb1 tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-86a32336-5879-43f7-bb5f-54436a4bff04-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-86a32336-5879-43f7-bb5f-54436a4bff04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-86a32336-5879-43f7-bb5f-54436a4bff04" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-86a32336-5879-43f7-bb5f-54436a4bff04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot 86a32336-5879-43f7-bb5f-54436a4bff04 of volume 7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa20a59b-a968-4ff2-a91c-317fdcb94fef]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:55 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 Sep 28 05:24:55 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:55 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04" returned: 0 in 0.361s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7730e046-9191-46e4-8573-35498cd0ef81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[195b39b9-d59a-4267-9379-e4ea1be1e28a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:55 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:55 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 Sep 28 05:24:55 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:56 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81" returned: 0 in 0.361s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:56 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 Sep 28 05:24:56 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:56 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04" returned: 0 in 0.325s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:56 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04 Sep 28 05:24:56 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:56 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81.86a32336-5879-43f7-bb5f-54436a4bff04" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-86a32336-5879-43f7-bb5f-54436a4bff04" released by "_delete_snapshot" :: held 1.386s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" released by "delete_snapshot" :: held 1.406s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Created reservations ['ead822f1-4659-4d00-81a1-b38f62cd415f', '7429bbd9-e94b-4ae3-a684-8e67bf63a838', 'e47968db-7688-4169-a694-b1bc85e6ef81', 'ea79bbcb-37fb-4247-8e56-b0d11b172b9c'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:56 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:24:56 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-6570927e-3952-45a9-81ef-f6dd73c1f8c0 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-86a32336-5879-43f7-bb5f-54436a4bff04-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-7730e046-9191-46e4-8573-35498cd0ef81-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-7730e046-9191-46e4-8573-35498cd0ef81-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f64fc3-a73f-4793-b753-a3dac3a8712d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:24:57 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:57 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 Sep 28 05:24:57 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:58 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:58 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81 Sep 28 05:24:58 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:58 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-7730e046-9191-46e4-8573-35498cd0ef81" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-7730e046-9191-46e4-8573-35498cd0ef81" released by "delete_volume" :: held 0.667s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Created reservations ['d3f0de8c-71d7-4927-8df9-ec22991448ac', '4e90af40-7a83-4285-96c9-12163cbc33ac', '81255fef-9c6b-4a6f-8831-d5aa7ead65b8', '751f38ed-efd5-4390-9cc5-23990a3275db'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:58 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:24:58 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:58 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:24:58 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:24:58 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-3c0e234d-3894-4abe-bdd2-cc4f62682d23 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-7730e046-9191-46e4-8573-35498cd0ef81-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (9ffb59ec-bd23-41d9-a044-f0ddc8cc9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5c1302-802e-49b8-bd59-0db3787166f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5c1302-802e-49b8-bd59-0db3787166f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910623947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05091029-46d6-4be1-a61f-3337bfbdff45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:59Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae2f49a-ab49-4076-a9be-600c52fb0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae2f49a-ab49-4076-a9be-600c52fb0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4009bc18-ab95-479e-a2cf-4993fe642a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4009bc18-ab95-479e-a2cf-4993fe642a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05091029-46d6-4be1-a61f-3337bfbdff45', 'volume_name': 'volume-05091029-46d6-4be1-a61f-3337bfbdff45', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d61d81-f528-4b2f-a503-e435b24c1e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d61d81-f528-4b2f-a503-e435b24c1e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b24214-42cd-4dd4-835d-83d06ed76df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Volume 05091029-46d6-4be1-a61f-3337bfbdff45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05091029-46d6-4be1-a61f-3337bfbdff45', 'volume_size': 1} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910623947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05091029-46d6-4be1-a61f-3337bfbdff45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f500e15c0348438daf2afec81c12c4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:24:59Z,use_quota=True,user_id='c0a2db4382d54e88958eba3183bb39d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Creating volume 05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:24:59 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:59 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 1073741824 Sep 28 05:24:59 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:59 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 1073741824" returned: 0 in 0.403s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:24:59 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 Sep 28 05:24:59 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:24:59 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45" returned: 0 in 0.255s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b24214-42cd-4dd4-835d-83d06ed76df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05091029-46d6-4be1-a61f-3337bfbdff45', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08210e84-3b82-4c1d-b642-4ef7d7e23beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:24:59 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Volume volume-05091029-46d6-4be1-a61f-3337bfbdff45 (05091029-46d6-4be1-a61f-3337bfbdff45): created successfully Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08210e84-3b82-4c1d-b642-4ef7d7e23beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:24:59 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Flow 'volume_create_manager' (9ffb59ec-bd23-41d9-a044-f0ddc8cc9e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:24:59 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9b97c746-3cf0-4120-a18c-7a68fe67f157 tempest-ProjectMemberTests-2095540116 None] Created volume successfully. Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Creating offline snapshot c9ecc38b-18f5-4210-8132-03e2fb29f99f of volume 05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde797ce-4778-4f13-bf85-a07e3f932de8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:00 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 Sep 28 05:25:00 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:00 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45" returned: 0 in 0.397s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:00 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:00 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f 1G Sep 28 05:25:00 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:01 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f 1G" returned: 0 in 0.388s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05091029-46d6-4be1-a61f-3337bfbdff45 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:01 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05091029-46d6-4be1-a61f-3337bfbdff45 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f Sep 28 05:25:01 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:01 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05091029-46d6-4be1-a61f-3337bfbdff45 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f" returned: 0 in 0.283s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:01 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f is being set with open permissions: ugo+rw Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:01 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f Sep 28 05:25:01 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:01 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:01 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info Sep 28 05:25:01 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:01 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:01 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info is being set with open permissions: ugo+rw Sep 28 05:25:01 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:01 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info Sep 28 05:25:01 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:02 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.info" returned: 0 in 0.251s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:02 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-a77c9d18-096b-437f-96b3-fdbf30eb8f2e tempest-ProjectMemberTests-2095540116 None] Create snapshot completed successfully Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-c9ecc38b-18f5-4210-8132-03e2fb29f99f-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-c9ecc38b-18f5-4210-8132-03e2fb29f99f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-c9ecc38b-18f5-4210-8132-03e2fb29f99f" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-c9ecc38b-18f5-4210-8132-03e2fb29f99f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Deleting offline snapshot c9ecc38b-18f5-4210-8132-03e2fb29f99f of volume 05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] snapshot_file for this snap is: volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ca241-c4fd-43b6-a4e5-56dd922e55ba]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:02 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f Sep 28 05:25:02 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:02 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f" returned: 0 in 0.366s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05091029-46d6-4be1-a61f-3337bfbdff45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769dc62-7b17-42d9-a558-49732a7fbf06]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:02 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:03 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 Sep 28 05:25:03 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:03 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:03 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f Sep 28 05:25:03 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:03 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f" returned: 0 in 0.332s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:03 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f Sep 28 05:25:03 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:03 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45.c9ecc38b-18f5-4210-8132-03e2fb29f99f" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-c9ecc38b-18f5-4210-8132-03e2fb29f99f" released by "_delete_snapshot" :: held 1.403s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:03 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" released by "delete_snapshot" :: held 1.428s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Created reservations ['bac30318-4512-4a8c-a676-47c6e358d80e', 'f7c246b7-4f4c-4807-8077-d715baf70671', '44da85c4-4041-4617-87a1-bb5981e337ba', '281d9e55-1771-4fb9-a137-6083784d899f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:04 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Delete snapshot completed successfully. Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73a0818d-6a7f-4bc0-92cc-0959a89d6432 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-c9ecc38b-18f5-4210-8132-03e2fb29f99f-delete_snapshot" released by "delete_snapshot" :: held 1.559s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-05091029-46d6-4be1-a61f-3337bfbdff45-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-05091029-46d6-4be1-a61f-3337bfbdff45-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43a64b-b599-44e1-a1ad-7077c11ef101]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:04 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:04 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 Sep 28 05:25:04 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:05 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:05 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45 Sep 28 05:25:05 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:05 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-05091029-46d6-4be1-a61f-3337bfbdff45" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-quobyte-05091029-46d6-4be1-a61f-3337bfbdff45" released by "delete_volume" :: held 0.667s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Created reservations ['ac890792-ac51-4d4b-b32e-c9775ca74737', 'd46335f5-1a24-4304-8d3f-269f2397c00e', 'd9914b0d-ca1d-4c4e-ad55-fff97f288cc2', '8ef4d2ed-7f0b-4bc5-9485-4c6ef60401f4'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:05 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:05 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:05 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:05 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Deleted volume successfully. Sep 28 05:25:05 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-fcf3294f-56e4-42a0-bcfe-fd4df40a7b87 tempest-ProjectMemberTests-2095540116 None] Lock "cinder-05091029-46d6-4be1-a61f-3337bfbdff45-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (040ca517-9c00-4804-8979-580c5ff98075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f16077-bd4a-4d8f-bf96-b7a6625ac275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f16077-bd4a-4d8f-bf96-b7a6625ac275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660324510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f5894e-1e48-455a-aaf8-8632db52c119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:09Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebc91e1-7846-4740-b3ce-07ee5a826822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebc91e1-7846-4740-b3ce-07ee5a826822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32e0aba-c40e-4f7c-8897-33a3e7b1bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32e0aba-c40e-4f7c-8897-33a3e7b1bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f5894e-1e48-455a-aaf8-8632db52c119', 'volume_name': 'volume-34f5894e-1e48-455a-aaf8-8632db52c119', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b1c03a-0ac2-4507-8f8e-cc6bc8cece37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b1c03a-0ac2-4507-8f8e-cc6bc8cece37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff821c63-ea62-4e9e-b754-53fb6f9140fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:09 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Volume 34f5894e-1e48-455a-aaf8-8632db52c119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f5894e-1e48-455a-aaf8-8632db52c119', 'volume_size': 1} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660324510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f5894e-1e48-455a-aaf8-8632db52c119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:09Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Creating volume 34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:25:09 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:09 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 1073741824 Sep 28 05:25:09 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:09 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 1073741824" returned: 0 in 0.405s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:09 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:09 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 Sep 28 05:25:09 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:10 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119" returned: 0 in 0.275s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff821c63-ea62-4e9e-b754-53fb6f9140fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f5894e-1e48-455a-aaf8-8632db52c119', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71929496-83ab-4a61-8e91-8f09c91a2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:10 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Volume volume-34f5894e-1e48-455a-aaf8-8632db52c119 (34f5894e-1e48-455a-aaf8-8632db52c119): created successfully Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71929496-83ab-4a61-8e91-8f09c91a2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (040ca517-9c00-4804-8979-580c5ff98075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:10 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-6416272e-768b-446b-8a73-521825dcfa14 tempest-ProjectReaderTests-898077019 None] Created volume successfully. Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Creating offline snapshot ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 of volume 34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8cbff-8320-4153-9089-b9d3dc9e79fa]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:10 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 Sep 28 05:25:10 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:10 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119" returned: 0 in 0.367s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:10 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:10 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 1G Sep 28 05:25:10 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:11 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 1G" returned: 0 in 0.401s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f5894e-1e48-455a-aaf8-8632db52c119 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:11 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f5894e-1e48-455a-aaf8-8632db52c119 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 Sep 28 05:25:11 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:11 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f5894e-1e48-455a-aaf8-8632db52c119 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" returned: 0 in 0.288s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:11 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 is being set with open permissions: ugo+rw Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:11 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 Sep 28 05:25:11 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:11 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" returned: 0 in 0.240s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:11 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:11 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info Sep 28 05:25:11 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:12 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:12 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info is being set with open permissions: ugo+rw Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:12 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info Sep 28 05:25:12 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:12 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.info" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:12 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7af59d78-19fb-458b-8c57-46360f9d7cb3 tempest-ProjectReaderTests-898077019 None] Create snapshot completed successfully Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Deleting offline snapshot ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 of volume 34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] snapshot_file for this snap is: volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f10095-4c30-48cd-9ecd-d2d8969e7b82]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:12 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:12 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 Sep 28 05:25:12 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:13 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" returned: 0 in 0.359s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f5894e-1e48-455a-aaf8-8632db52c119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62929d33-6a34-4402-88ef-c3a7ab145c03]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:13 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 Sep 28 05:25:13 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:13 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119" returned: 0 in 0.353s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:13 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 Sep 28 05:25:13 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:13 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" returned: 0 in 0.339s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:13 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:13 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9 Sep 28 05:25:13 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:14 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119.ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" returned: 0 in 0.253s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9" released by "_delete_snapshot" :: held 1.409s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" released by "delete_snapshot" :: held 1.430s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Created reservations ['0c69a20e-0b4f-4260-84ba-4d117ea6b86b', '00f50279-315a-48fb-8b21-76917bf19af2', '343be39f-b44d-40ec-908a-6de8682f85b2', '3efc2dd0-183d-40f4-96bc-76db9ce5e4f8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:14 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Delete snapshot completed successfully. Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-73d4ee57-cd60-48cd-8c5d-90cb121f197a tempest-ProjectReaderTests-898077019 None] Lock "cinder-ead85d3e-073c-4ec5-9ac2-80f19d83e3a9-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-34f5894e-1e48-455a-aaf8-8632db52c119-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "cinder-34f5894e-1e48-455a-aaf8-8632db52c119-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[835198a1-0037-4e57-90c7-e94b43d38aa5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:14 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:15 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 Sep 28 05:25:15 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:15 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119" returned: 0 in 0.361s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:15 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119 Sep 28 05:25:15 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:15 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-34f5894e-1e48-455a-aaf8-8632db52c119" returned: 0 in 0.244s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-34f5894e-1e48-455a-aaf8-8632db52c119" released by "delete_volume" :: held 0.665s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Created reservations ['714ebaf7-b38e-4d11-ac39-8434169cfcd2', 'b5d3843e-228d-4b0a-a022-b48f93f66fa1', 'c13ceae2-1759-4aaa-847b-8e5a00efb737', '894a6476-86d9-470c-baca-83b7e3eaa85f'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:15 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:15 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:15 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:15 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Deleted volume successfully. Sep 28 05:25:15 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7c97b491-5bdb-4fb2-8dd8-cce8f0e4817f tempest-ProjectReaderTests-898077019 None] Lock "cinder-34f5894e-1e48-455a-aaf8-8632db52c119-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (8b5d4166-05ca-4931-94b3-011ce1fa2394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11c7a09-7942-453f-a757-2de3b02ac49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11c7a09-7942-453f-a757-2de3b02ac49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121468100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7417ea-82e5-4e40-aa8e-bdb2d3677beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:16Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c7287-6721-4d7f-8686-f4ce903d6065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c7287-6721-4d7f-8686-f4ce903d6065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba6997-1dbc-451f-a75f-807be7cca4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba6997-1dbc-451f-a75f-807be7cca4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7417ea-82e5-4e40-aa8e-bdb2d3677beb', 'volume_name': 'volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04737aa-5fa8-4851-96b7-929f290f98ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04737aa-5fa8-4851-96b7-929f290f98ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef40b393-5c9c-4390-8c6c-28495dbab825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:16 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Volume dd7417ea-82e5-4e40-aa8e-bdb2d3677beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb', 'volume_size': 1} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121468100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7417ea-82e5-4e40-aa8e-bdb2d3677beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:16Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Creating volume dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:25:16 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:16 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb 1073741824 Sep 28 05:25:16 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:16 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb 1073741824" returned: 0 in 0.418s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:16 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:16 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb Sep 28 05:25:16 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:17 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef40b393-5c9c-4390-8c6c-28495dbab825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbebce9-f3f8-4fd3-b3cf-ea4750f415fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:17 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Volume volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb (dd7417ea-82e5-4e40-aa8e-bdb2d3677beb): created successfully Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbebce9-f3f8-4fd3-b3cf-ea4750f415fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (8b5d4166-05ca-4931-94b3-011ce1fa2394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:17 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9c951803-54ed-495e-adac-c036489bc86d tempest-ProjectReaderTests-898077019 None] Created volume successfully. Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Creating offline snapshot fb74a256-372f-46c9-8112-23e46814edc3 of volume dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[911b513b-b93b-458a-a848-06e24be74b1e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:17 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb Sep 28 05:25:17 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:17 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" returned: 0 in 0.372s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:17 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 1G Sep 28 05:25:17 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:18 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 1G" returned: 0 in 0.381s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:18 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 Sep 28 05:25:18 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:18 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3" returned: 0 in 0.289s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:18 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 is being set with open permissions: ugo+rw Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:18 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 Sep 28 05:25:18 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:18 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:18 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:18 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info Sep 28 05:25:18 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:19 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info" returned: 0 in 0.264s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:19 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info is being set with open permissions: ugo+rw Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:19 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info Sep 28 05:25:19 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:19 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.info" returned: 0 in 0.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-3bd7adb7-6cca-4cd2-9c0e-bbefe20d68a9 tempest-ProjectReaderTests-898077019 None] Create snapshot completed successfully Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-fb74a256-372f-46c9-8112-23e46814edc3-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-fb74a256-372f-46c9-8112-23e46814edc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-fb74a256-372f-46c9-8112-23e46814edc3" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fb74a256-372f-46c9-8112-23e46814edc3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Deleting offline snapshot fb74a256-372f-46c9-8112-23e46814edc3 of volume dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] snapshot_file for this snap is: volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed675073-49b7-48c6-870e-29a7590f7513]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:19 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:19 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 Sep 28 05:25:19 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:20 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3" returned: 0 in 0.369s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975e965-8850-4700-9e50-6762f2c7bccf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:20 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb Sep 28 05:25:20 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:20 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" returned: 0 in 0.356s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:20 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 Sep 28 05:25:20 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:20 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:20 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:20 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3 Sep 28 05:25:20 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:21 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb.fb74a256-372f-46c9-8112-23e46814edc3" returned: 0 in 0.256s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fb74a256-372f-46c9-8112-23e46814edc3" released by "_delete_snapshot" :: held 1.406s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" released by "delete_snapshot" :: held 1.428s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Created reservations ['8e1edd6b-17b7-4f4b-be9f-0aa675c9655e', '96a45a06-eeec-4bce-9d79-086241894335', 'ec40d890-f264-4f82-9c75-fb44a23251cd', '4bda3895-2c2b-4b11-b0c3-0d8c8b88799d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:21 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Delete snapshot completed successfully. Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7b2a92f2-0132-4a02-b4fb-67f548c85a7c tempest-ProjectReaderTests-898077019 None] Lock "cinder-fb74a256-372f-46c9-8112-23e46814edc3-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "cinder-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" acquired by "delete_volume" :: waited 0.022s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b14901-6bf6-4a93-8b72-deb4e44cd482]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:21 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:22 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb Sep 28 05:25:22 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:22 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" returned: 0 in 0.363s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:22 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb Sep 28 05:25:22 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:22 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb" released by "delete_volume" :: held 0.675s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Created reservations ['c578aa51-556f-4ac7-9c7f-5ed27e1359a9', 'b7bdf814-ce04-4aad-895e-efd55ca4246d', '60c598f5-0596-4989-8215-f5e067d4ee7a', '52b867ae-6390-4eb5-a55e-7569386c5ef0'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:22 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:22 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:22 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:22 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Deleted volume successfully. Sep 28 05:25:22 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-79e47047-7841-4e89-bf94-1f06d733542a tempest-ProjectReaderTests-898077019 None] Lock "cinder-dd7417ea-82e5-4e40-aa8e-bdb2d3677beb-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (3fd30879-a3a3-49b3-a6bf-1fa127d45736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25571dd6-ba92-430f-90ab-7e0702b7e624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25571dd6-ba92-430f-90ab-7e0702b7e624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373895303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c57d85a-fb7a-4ea3-b241-f8336c595ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:23Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f67ed9-efba-457b-af6a-593d0e5fc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f67ed9-efba-457b-af6a-593d0e5fc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff44e8-735f-4045-8cc1-59d0cdfc7ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ff44e8-735f-4045-8cc1-59d0cdfc7ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c57d85a-fb7a-4ea3-b241-f8336c595ec7', 'volume_name': 'volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f59831-3dfc-4878-aa6e-ab027991c7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f59831-3dfc-4878-aa6e-ab027991c7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891dde79-e466-4cb4-863f-d99b2af03af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:23 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Volume 4c57d85a-fb7a-4ea3-b241-f8336c595ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7', 'volume_size': 1} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373895303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c57d85a-fb7a-4ea3-b241-f8336c595ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:23Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Creating volume 4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:25:23 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:23 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 1073741824 Sep 28 05:25:23 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:23 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 1073741824" returned: 0 in 0.411s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:23 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:23 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 Sep 28 05:25:23 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:24 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891dde79-e466-4cb4-863f-d99b2af03af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef742e7-b723-4eb5-b49a-a3dead1208be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:24 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Volume volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 (4c57d85a-fb7a-4ea3-b241-f8336c595ec7): created successfully Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef742e7-b723-4eb5-b49a-a3dead1208be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (3fd30879-a3a3-49b3-a6bf-1fa127d45736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:24 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-237db968-0c44-4f1e-909e-f142e21d0d77 tempest-ProjectReaderTests-898077019 None] Created volume successfully. Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Creating offline snapshot bd4d7c06-8fd0-4627-b450-73b46a4e3687 of volume 4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad3de3-6b61-480a-94e6-beeb22ce63e0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:24 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 Sep 28 05:25:24 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:24 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:24 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:24 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 1G Sep 28 05:25:24 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:25 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 1G" returned: 0 in 0.393s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:25 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 Sep 28 05:25:25 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:25 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687" returned: 0 in 0.291s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:25 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 is being set with open permissions: ugo+rw Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:25 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 Sep 28 05:25:25 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:25 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:25 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:25 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info Sep 28 05:25:25 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:26 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info" returned: 0 in 0.256s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:26 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info is being set with open permissions: ugo+rw Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:26 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info Sep 28 05:25:26 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:26 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.info" returned: 0 in 0.241s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:26 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-9ce111b7-401f-4ac6-899b-cad078527c10 tempest-ProjectReaderTests-898077019 None] Create snapshot completed successfully Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-bd4d7c06-8fd0-4627-b450-73b46a4e3687-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-bd4d7c06-8fd0-4627-b450-73b46a4e3687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-bd4d7c06-8fd0-4627-b450-73b46a4e3687" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-bd4d7c06-8fd0-4627-b450-73b46a4e3687" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Deleting offline snapshot bd4d7c06-8fd0-4627-b450-73b46a4e3687 of volume 4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] snapshot_file for this snap is: volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a108fb-98da-4054-a853-13e7f5fdaac3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:26 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:26 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 Sep 28 05:25:26 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:27 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687" returned: 0 in 0.362s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fb320-2ec1-4967-b55c-5defa7b108ba]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:27 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 Sep 28 05:25:27 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:27 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" returned: 0 in 0.358s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:27 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 Sep 28 05:25:27 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:27 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687" returned: 0 in 0.330s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:27 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:27 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687 Sep 28 05:25:27 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:28 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7.bd4d7c06-8fd0-4627-b450-73b46a4e3687" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-bd4d7c06-8fd0-4627-b450-73b46a4e3687" released by "_delete_snapshot" :: held 1.402s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" released by "delete_snapshot" :: held 1.424s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Created reservations ['b6a078e2-e9e3-4742-870a-c1346249615c', '97a55210-3392-4e12-9162-ab268801dbac', '256c6854-498c-455f-b54c-5da8540ec1cd', '266facaa-d6f4-4cb3-b50a-7cf636e63347'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:28 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Delete snapshot completed successfully. Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-4992fb41-cf7d-4062-bda7-020beb0cf90d tempest-ProjectReaderTests-898077019 None] Lock "cinder-bd4d7c06-8fd0-4627-b450-73b46a4e3687-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-4c57d85a-fb7a-4ea3-b241-f8336c595ec7-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "cinder-4c57d85a-fb7a-4ea3-b241-f8336c595ec7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" acquired by "delete_volume" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d0332c-604b-4edc-b35a-b184778c8e5e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:28 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:29 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 Sep 28 05:25:29 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:29 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" returned: 0 in 0.376s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:29 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7 Sep 28 05:25:29 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:29 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:29 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:29 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-4c57d85a-fb7a-4ea3-b241-f8336c595ec7" released by "delete_volume" :: held 0.692s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Created reservations ['90cbf4d3-699d-40b5-9b9c-a0630d28c77c', '12d049c9-21ff-467e-a533-02862ed00259', 'e240215e-072c-4257-a69b-ce12764be9c0', '66136869-1345-4eb8-bece-e9dd51014ae8'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:29 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.259s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_service.periodic_task [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] Running periodic task VolumeManager._thread_info {{(pid=86815) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread count: 28 {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-c2cb93ac-f1a9-4df3-b7ae-adeb73a17c09 None None] thread info: [<_MainThread(MainThread, started 131707787485312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86815) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:29 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:29 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:29 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.257s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:29 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Deleted volume successfully. Sep 28 05:25:29 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-7fdc0a33-8903-4140-9f89-88bb7f22ff04 tempest-ProjectReaderTests-898077019 None] Lock "cinder-4c57d85a-fb7a-4ea3-b241-f8336c595ec7-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (bf609096-9090-4f84-ac50-588c994d8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b62309-f8da-4ce9-959d-6f0377840428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b62309-f8da-4ce9-959d-6f0377840428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83877713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d6ee5e-dfee-4f12-9637-dd9ebe298ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:30Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02cb6d9-8fce-46de-aecd-db52cafe0d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02cb6d9-8fce-46de-aecd-db52cafe0d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a4dfad-61c2-4b26-9690-a88d2659dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a4dfad-61c2-4b26-9690-a88d2659dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d6ee5e-dfee-4f12-9637-dd9ebe298ba8', 'volume_name': 'volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d51edb-90e3-4e3a-8f89-b77ff500d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d51edb-90e3-4e3a-8f89-b77ff500d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d725ba-04a1-4608-bc04-7366954cdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:30 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Volume 10d6ee5e-dfee-4f12-9637-dd9ebe298ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8', 'volume_size': 1} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83877713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d6ee5e-dfee-4f12-9637-dd9ebe298ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:30Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Creating volume 10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:25:30 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:30 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 1073741824 Sep 28 05:25:30 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:30 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 1073741824" returned: 0 in 0.420s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:30 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:30 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 Sep 28 05:25:30 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:31 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d725ba-04a1-4608-bc04-7366954cdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a2e0c8-3e83-4457-a1a5-dfc075b482aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:31 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Volume volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 (10d6ee5e-dfee-4f12-9637-dd9ebe298ba8): created successfully Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a2e0c8-3e83-4457-a1a5-dfc075b482aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (bf609096-9090-4f84-ac50-588c994d8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:31 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-f6746a12-a59c-4da1-bbc7-c8f81dfffcc0 tempest-ProjectReaderTests-898077019 None] Created volume successfully. Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Creating offline snapshot a5deedb6-dc8b-4109-9c66-fbaa449f0f26 of volume 10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ac847-478d-4197-aa72-50c7851391c9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:31 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 Sep 28 05:25:31 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:31 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" returned: 0 in 0.369s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:31 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:32 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 1G Sep 28 05:25:32 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:32 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 1G" returned: 0 in 0.389s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:32 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 Sep 28 05:25:32 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:32 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26" returned: 0 in 0.282s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:32 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 is being set with open permissions: ugo+rw Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:32 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 Sep 28 05:25:32 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:32 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26" returned: 0 in 0.239s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:32 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:32 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info Sep 28 05:25:32 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:33 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info" returned: 0 in 0.250s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:33 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info is being set with open permissions: ugo+rw Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:33 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info Sep 28 05:25:33 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:33 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.info" returned: 0 in 0.239s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:33 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8030609f-373c-426b-a2df-f1813e5967dd tempest-ProjectReaderTests-898077019 None] Create snapshot completed successfully Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-a5deedb6-dc8b-4109-9c66-fbaa449f0f26-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-a5deedb6-dc8b-4109-9c66-fbaa449f0f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-a5deedb6-dc8b-4109-9c66-fbaa449f0f26" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-a5deedb6-dc8b-4109-9c66-fbaa449f0f26" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Deleting offline snapshot a5deedb6-dc8b-4109-9c66-fbaa449f0f26 of volume 10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] snapshot_file for this snap is: volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b5d22-a329-4c0a-9c4b-639be420a08a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:33 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:33 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 Sep 28 05:25:33 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:34 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26" returned: 0 in 0.366s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c398092-8754-4714-8ce7-ea62400a93e2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:34 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 Sep 28 05:25:34 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:34 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" returned: 0 in 0.352s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:34 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 Sep 28 05:25:34 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:34 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26" returned: 0 in 0.337s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:34 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:34 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26 Sep 28 05:25:34 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:35 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8.a5deedb6-dc8b-4109-9c66-fbaa449f0f26" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-a5deedb6-dc8b-4109-9c66-fbaa449f0f26" released by "_delete_snapshot" :: held 1.395s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" released by "delete_snapshot" :: held 1.416s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Created reservations ['0362eb45-4017-418b-bd00-8d036093723a', '5389927c-3873-4c7d-b338-c4d3c98126f4', '63b162d7-1ebc-43e8-a449-02cab7febc3d', 'bc6b5a5d-4fa1-41b2-8c98-2f1f3fd661bf'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:35 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Delete snapshot completed successfully. Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-b5edcf6f-2629-4976-abc1-8b7f8a844621 tempest-ProjectReaderTests-898077019 None] Lock "cinder-a5deedb6-dc8b-4109-9c66-fbaa449f0f26-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "cinder-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" acquired by "delete_volume" :: waited 0.016s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[556beffe-ccfb-411e-8055-78574fa4a577]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:35 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:36 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 Sep 28 05:25:36 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:36 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:36 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8 Sep 28 05:25:36 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:36 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" returned: 0 in 0.242s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8" released by "delete_volume" :: held 0.664s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Created reservations ['9b40e858-6b31-4b68-894e-61c95f666a20', '96293eef-4aa9-47bd-b405-c8ac87d5f2ce', '6678d2c4-8b54-4f64-95d7-e8aed5703c38', 'ce7b8413-d853-4512-82b7-e6e57e485eef'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:36 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:36 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:36 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.246s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:36 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Deleted volume successfully. Sep 28 05:25:36 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-8eae6de2-a790-454c-bb44-7b0380070280 tempest-ProjectReaderTests-898077019 None] Lock "cinder-10d6ee5e-dfee-4f12-9637-dd9ebe298ba8-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86815) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (3613ab62-a19b-42ed-b363-ff3f9cc2d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6638e6bf-3447-4e37-b178-cc6c17a6fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6638e6bf-3447-4e37-b178-cc6c17a6fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791100022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc41ba9a-4eec-4e22-b96c-763599569c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:37Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3720a9d-552f-47ac-b8d0-ad310a97618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3720a9d-552f-47ac-b8d0-ad310a97618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf9b731-c0dd-4290-9894-98da3ed88f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf9b731-c0dd-4290-9894-98da3ed88f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc41ba9a-4eec-4e22-b96c-763599569c1f', 'volume_name': 'volume-fc41ba9a-4eec-4e22-b96c-763599569c1f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b33d26-3eb5-4c7a-84a1-2d6fba7e807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b33d26-3eb5-4c7a-84a1-2d6fba7e807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434998fb-909e-48c1-b999-22d039f2aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:37 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Volume fc41ba9a-4eec-4e22-b96c-763599569c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc41ba9a-4eec-4e22-b96c-763599569c1f', 'volume_size': 1} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791100022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc41ba9a-4eec-4e22-b96c-763599569c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093485e094074f36a630f20de8deb2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T03:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T03:25:37Z,use_quota=True,user_id='2dbb113429aa4e119f2a0f1649cf20f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84e2699-c031-44a7-a8d6-4808e35743b1),volume_type_id=d84e2699-c031-44a7-a8d6-4808e35743b1)}" {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Creating volume fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Selected osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 as target Quobyte volume. {{(pid=86815) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 05:25:37 devstack cinder-volume[86815]: INFO cinder.volume.drivers.remotefs [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] casted to osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46 Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f 1073741824 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:37 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f 1073741824 Sep 28 05:25:37 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:37 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f 1073741824" returned: 0 in 0.415s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:37 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:37 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f Sep 28 05:25:37 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:38 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'} {{(pid=86815) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434998fb-909e-48c1-b999-22d039f2aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc41ba9a-4eec-4e22-b96c-763599569c1f', 'volume_size': 1}' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a77d0cf-b582-43f3-b58e-4fabe542f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 05:25:38 devstack cinder-volume[86815]: INFO cinder.volume.flows.manager.create_volume [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Volume volume-fc41ba9a-4eec-4e22-b96c-763599569c1f (fc41ba9a-4eec-4e22-b96c-763599569c1f): created successfully Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a77d0cf-b582-43f3-b58e-4fabe542f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86815) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Flow 'volume_create_manager' (3613ab62-a19b-42ed-b363-ff3f9cc2d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86815) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 05:25:38 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-4bca2d91-b14a-4d45-978d-97f71b35d71c tempest-ProjectReaderTests-898077019 None] Created volume successfully. Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Creating offline snapshot f389e241-e113-4f7c-bc67-476288bf6998 of volume fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1af833-2fa7-48c2-985e-a267e82cd85d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:38 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f Sep 28 05:25:38 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:38 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f" returned: 0 in 0.364s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:38 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 1G {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:39 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 1G Sep 28 05:25:39 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:39 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 1G" returned: 0 in 0.384s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc41ba9a-4eec-4e22-b96c-763599569c1f -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:39 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc41ba9a-4eec-4e22-b96c-763599569c1f -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 Sep 28 05:25:39 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:39 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc41ba9a-4eec-4e22-b96c-763599569c1f -F qcow2 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998" returned: 0 in 0.287s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:39 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 is being set with open permissions: ugo+rw Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:39 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 Sep 28 05:25:39 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:39 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998" returned: 0 in 0.245s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:39 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:39 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info Sep 28 05:25:39 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:40 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info" returned: 0 in 0.247s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:40 devstack cinder-volume[86815]: WARNING cinder.volume.drivers.remotefs [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info is being set with open permissions: ugo+rw Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:40 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info Sep 28 05:25:40 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:40 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.info" returned: 0 in 0.243s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:40 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-da9ece85-bd36-4c1a-809f-f62121373ce5 tempest-ProjectReaderTests-898077019 None] Create snapshot completed successfully Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-f389e241-e113-4f7c-bc67-476288bf6998-delete_snapshot" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-f389e241-e113-4f7c-bc67-476288bf6998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" by "delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-f389e241-e113-4f7c-bc67-476288bf6998" by "_delete_snapshot" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-f389e241-e113-4f7c-bc67-476288bf6998" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Deleting offline snapshot f389e241-e113-4f7c-bc67-476288bf6998 of volume fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] snapshot_file for this snap is: volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b29899-cac7-4d36-9afa-a854c4eff27d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:40 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:40 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 Sep 28 05:25:40 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:41 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998" returned: 0 in 0.363s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.remotefs [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc41ba9a-4eec-4e22-b96c-763599569c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86815) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddf66b-17db-40da-a2b6-814db8aa10c2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:41 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f Sep 28 05:25:41 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:41 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f" returned: 0 in 0.354s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:41 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 Sep 28 05:25:41 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:41 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998" returned: 0 in 0.331s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:41 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:41 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998 Sep 28 05:25:41 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:42 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f.f389e241-e113-4f7c-bc67-476288bf6998" returned: 0 in 0.248s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-f389e241-e113-4f7c-bc67-476288bf6998" released by "_delete_snapshot" :: held 1.391s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" released by "delete_snapshot" :: held 1.410s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:UPDATE=141,cinder:DELETE=13,cinder:SELECT=110,cinder:INSERT=44 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=119,cinder:INSERT=37,cinder:UPDATE=149,cinder:DELETE=12 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Created reservations ['0799df35-cb05-409e-8137-8fad9e4a569e', 'dc63eab1-332d-4659-973d-ef96ee3e277e', 'f31a4eae-0f9c-4b21-b3df-b1636e6f98dd', 'c91ff129-a57e-4b37-9b62-9586ee77a692'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:42 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Delete snapshot completed successfully. Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bff0aa86-23ae-4562-8f84-71244dc9c882 tempest-ProjectReaderTests-898077019 None] Lock "cinder-f389e241-e113-4f7c-bc67-476288bf6998-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-fc41ba9a-4eec-4e22-b96c-763599569c1f-delete_volume" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "cinder-fc41ba9a-4eec-4e22-b96c-763599569c1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Acquiring lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" by "delete_volume" {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" acquired by "delete_volume" :: waited 0.017s {{(pid=86815) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG oslo.privsep.daemon [-] privsep: reply[378a6351-70ac-4dc6-b13a-2cef3bc97a57]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 05:25:42 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:43 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f Sep 28 05:25:43 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:43 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f" returned: 0 in 0.368s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:43 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f Sep 28 05:25:43 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:43 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5/volume-fc41ba9a-4eec-4e22-b96c-763599569c1f" returned: 0 in 0.249s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "cinder-quobyte-fc41ba9a-4eec-4e22-b96c-763599569c1f" released by "delete_volume" :: held 0.678s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG cinder.quota [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Created reservations ['681fa358-5a84-4339-9295-92a2f964ffe1', '30b33ca7-98db-40e2-ad86-3070346caff7', 'd4033569-752e-42bc-a12c-a985f14c09bd', 'f520dee4-e5b0-48dd-b880-c53559e2de5d'] {{(pid=86815) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46': None} {{(pid=86815) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG cinder.volume.drivers.quobyte [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-abe75c2d-50b5-4828-bc19-79882ce30b46'] {{(pid=86815) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86815) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 05:25:43 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5 Sep 28 05:25:43 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 05:25:43 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG oslo_concurrency.processutils [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05f5466c8c2e947401b2b109c2c0aac5" returned: 0 in 0.266s {{(pid=86815) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 05:25:43 devstack cinder-volume[86815]: DEBUG cinder.manager [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Notifying Schedulers of capabilities ... {{(pid=86815) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 05:25:44 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Deleted volume successfully. Sep 28 05:25:44 devstack cinder-volume[86815]: DEBUG cinder.coordination [None req-bfef66ff-ca22-4df9-aaaf-7e3a0bfa0bfa tempest-ProjectReaderTests-898077019 None] Lock "cinder-fc41ba9a-4eec-4e22-b96c-763599569c1f-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86815) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 05:25:53 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=12 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 05:25:54 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:INSERT=4,cinder:UPDATE=15,cinder:SELECT=7,cinder:DELETE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}